diff --git a/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_en.md b/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_en.md new file mode 100644 index 00000000000000..a5e99fa3affbe8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 0417_t5_baseline_checkpoint_9500 T5Transformer from Luluuu +author: John Snow Labs +name: 0417_t5_baseline_checkpoint_9500 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`0417_t5_baseline_checkpoint_9500` is a English model originally trained by Luluuu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_en_5.4.2_3.0_1724453926632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_en_5.4.2_3.0_1724453926632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("0417_t5_baseline_checkpoint_9500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("0417_t5_baseline_checkpoint_9500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|0417_t5_baseline_checkpoint_9500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Luluuu/0417_T5_baseline_checkpoint_9500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_pipeline_en.md new file mode 100644 index 00000000000000..1d3f7042bb1b05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-0417_t5_baseline_checkpoint_9500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 0417_t5_baseline_checkpoint_9500_pipeline pipeline T5Transformer from Luluuu +author: John Snow Labs +name: 0417_t5_baseline_checkpoint_9500_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`0417_t5_baseline_checkpoint_9500_pipeline` is a English model originally trained by Luluuu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_pipeline_en_5.4.2_3.0_1724454072827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_pipeline_en_5.4.2_3.0_1724454072827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("0417_t5_baseline_checkpoint_9500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("0417_t5_baseline_checkpoint_9500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|0417_t5_baseline_checkpoint_9500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Luluuu/0417_T5_baseline_checkpoint_9500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-20240223_8_en.md b/docs/_posts/ahmedlone127/2024-08-23-20240223_8_en.md new file mode 100644 index 00000000000000..df1e3e403cfa28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-20240223_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240223_8 T5Transformer from picas9dan +author: John Snow Labs +name: 20240223_8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240223_8` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240223_8_en_5.4.2_3.0_1724410584140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240223_8_en_5.4.2_3.0_1724410584140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240223_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240223_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240223_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240223_8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-20240223_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-20240223_8_pipeline_en.md new file mode 100644 index 00000000000000..04ca5ff04fea08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-20240223_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240223_8_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240223_8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240223_8_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240223_8_pipeline_en_5.4.2_3.0_1724410728536.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240223_8_pipeline_en_5.4.2_3.0_1724410728536.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240223_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240223_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240223_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240223_8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_en.md b/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_en.md new file mode 100644 index 00000000000000..e07b2b1200a0b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 9epochisdabest T5Transformer from atulxop +author: John Snow Labs +name: 9epochisdabest +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`9epochisdabest` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/9epochisdabest_en_5.4.2_3.0_1724440344617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/9epochisdabest_en_5.4.2_3.0_1724440344617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("9epochisdabest","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("9epochisdabest", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|9epochisdabest| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.4 MB| + +## References + +https://huggingface.co/atulxop/9epochisdabest \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_pipeline_en.md new file mode 100644 index 00000000000000..49a9abed03a035 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-9epochisdabest_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 9epochisdabest_pipeline pipeline T5Transformer from atulxop +author: John Snow Labs +name: 9epochisdabest_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`9epochisdabest_pipeline` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/9epochisdabest_pipeline_en_5.4.2_3.0_1724440361899.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/9epochisdabest_pipeline_en_5.4.2_3.0_1724440361899.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("9epochisdabest_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("9epochisdabest_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|9epochisdabest_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.4 MB| + +## References + +https://huggingface.co/atulxop/9epochisdabest + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_en.md new file mode 100644 index 00000000000000..1f603505309f57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrikans_sum_v1 T5Transformer from mHossain +author: John Snow Labs +name: afrikans_sum_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrikans_sum_v1` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrikans_sum_v1_en_5.4.2_3.0_1724409283623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrikans_sum_v1_en_5.4.2_3.0_1724409283623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrikans_sum_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrikans_sum_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrikans_sum_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.3 MB| + +## References + +https://huggingface.co/mHossain/afrikans_sum_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_pipeline_en.md new file mode 100644 index 00000000000000..2acf9a73038308 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-afrikans_sum_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrikans_sum_v1_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: afrikans_sum_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrikans_sum_v1_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrikans_sum_v1_pipeline_en_5.4.2_3.0_1724409310543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrikans_sum_v1_pipeline_en_5.4.2_3.0_1724409310543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrikans_sum_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrikans_sum_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrikans_sum_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.3 MB| + +## References + +https://huggingface.co/mHossain/afrikans_sum_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_en.md b/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_en.md new file mode 100644 index 00000000000000..2aeb02a77904b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ans_gen2 T5Transformer from santhoshkolloju +author: John Snow Labs +name: ans_gen2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ans_gen2` is a English model originally trained by santhoshkolloju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ans_gen2_en_5.4.2_3.0_1724441593957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ans_gen2_en_5.4.2_3.0_1724441593957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ans_gen2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ans_gen2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ans_gen2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/santhoshkolloju/ans_gen2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_pipeline_en.md new file mode 100644 index 00000000000000..1c6d75d581e41c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ans_gen2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ans_gen2_pipeline pipeline T5Transformer from santhoshkolloju +author: John Snow Labs +name: ans_gen2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ans_gen2_pipeline` is a English model originally trained by santhoshkolloju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ans_gen2_pipeline_en_5.4.2_3.0_1724441644626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ans_gen2_pipeline_en_5.4.2_3.0_1724441644626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ans_gen2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ans_gen2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ans_gen2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/santhoshkolloju/ans_gen2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_en.md b/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_en.md new file mode 100644 index 00000000000000..7d15242446f2da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arxivedits_intention_classifier_t5_base_coarse T5Transformer from chaojiang06 +author: John Snow Labs +name: arxivedits_intention_classifier_t5_base_coarse +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arxivedits_intention_classifier_t5_base_coarse` is a English model originally trained by chaojiang06. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arxivedits_intention_classifier_t5_base_coarse_en_5.4.2_3.0_1724455668807.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arxivedits_intention_classifier_t5_base_coarse_en_5.4.2_3.0_1724455668807.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arxivedits_intention_classifier_t5_base_coarse","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arxivedits_intention_classifier_t5_base_coarse", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arxivedits_intention_classifier_t5_base_coarse| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|935.6 MB| + +## References + +https://huggingface.co/chaojiang06/arXivEdits-intention-classifier-T5-base-coarse \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_pipeline_en.md new file mode 100644 index 00000000000000..b13b2027a2a127 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-arxivedits_intention_classifier_t5_base_coarse_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arxivedits_intention_classifier_t5_base_coarse_pipeline pipeline T5Transformer from chaojiang06 +author: John Snow Labs +name: arxivedits_intention_classifier_t5_base_coarse_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arxivedits_intention_classifier_t5_base_coarse_pipeline` is a English model originally trained by chaojiang06. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arxivedits_intention_classifier_t5_base_coarse_pipeline_en_5.4.2_3.0_1724455735773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arxivedits_intention_classifier_t5_base_coarse_pipeline_en_5.4.2_3.0_1724455735773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arxivedits_intention_classifier_t5_base_coarse_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arxivedits_intention_classifier_t5_base_coarse_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arxivedits_intention_classifier_t5_base_coarse_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|935.6 MB| + +## References + +https://huggingface.co/chaojiang06/arXivEdits-intention-classifier-T5-base-coarse + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_en.md new file mode 100644 index 00000000000000..ae0cb61897ee4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English assignment2_attempt6 T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt6 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt6` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt6_en_5.4.2_3.0_1724451102156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt6_en_5.4.2_3.0_1724451102156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("assignment2_attempt6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("assignment2_attempt6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|783.7 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_pipeline_en.md new file mode 100644 index 00000000000000..24149876c1da81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English assignment2_attempt6_pipeline pipeline T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt6_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt6_pipeline` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt6_pipeline_en_5.4.2_3.0_1724451193540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt6_pipeline_en_5.4.2_3.0_1724451193540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("assignment2_attempt6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("assignment2_attempt6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|783.7 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..4172a09629d402 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_data_without_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_without_edge_document_level_t5_run2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_without_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724409728422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724409728422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_data_without_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_data_without_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_without_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.8 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_without_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..f4a48df2f6bc2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-augmented_data_without_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_data_without_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_without_edge_document_level_t5_run2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_without_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724409746526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724409746526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_data_without_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_data_without_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_without_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.8 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_without_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..b3503aca86a90e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724445317015.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724445317015.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_without_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..b02d601fa3b9fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724445339564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724445339564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.1 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_without_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_en.md b/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_en.md new file mode 100644 index 00000000000000..4f439d3aebf741 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_nlp_text_summarization_by_faisal_793224456 T5Transformer from faisalahmad2 +author: John Snow Labs +name: autotrain_nlp_text_summarization_by_faisal_793224456 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_nlp_text_summarization_by_faisal_793224456` is a English model originally trained by faisalahmad2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_nlp_text_summarization_by_faisal_793224456_en_5.4.2_3.0_1724413968983.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_nlp_text_summarization_by_faisal_793224456_en_5.4.2_3.0_1724413968983.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_nlp_text_summarization_by_faisal_793224456","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_nlp_text_summarization_by_faisal_793224456", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_nlp_text_summarization_by_faisal_793224456| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/faisalahmad2/autotrain-nlp-text-summarization-by-faisal-793224456 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_pipeline_en.md new file mode 100644 index 00000000000000..89e7a23f1617bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-autotrain_nlp_text_summarization_by_faisal_793224456_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_nlp_text_summarization_by_faisal_793224456_pipeline pipeline T5Transformer from faisalahmad2 +author: John Snow Labs +name: autotrain_nlp_text_summarization_by_faisal_793224456_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_nlp_text_summarization_by_faisal_793224456_pipeline` is a English model originally trained by faisalahmad2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_nlp_text_summarization_by_faisal_793224456_pipeline_en_5.4.2_3.0_1724414143196.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_nlp_text_summarization_by_faisal_793224456_pipeline_en_5.4.2_3.0_1724414143196.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_nlp_text_summarization_by_faisal_793224456_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_nlp_text_summarization_by_faisal_793224456_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_nlp_text_summarization_by_faisal_793224456_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/faisalahmad2/autotrain-nlp-text-summarization-by-faisal-793224456 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_en.md new file mode 100644 index 00000000000000..2e939fbfed90f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bcoqa_mt5 T5Transformer from arbitropy +author: John Snow Labs +name: bcoqa_mt5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bcoqa_mt5` is a English model originally trained by arbitropy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bcoqa_mt5_en_5.4.2_3.0_1724439784625.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bcoqa_mt5_en_5.4.2_3.0_1724439784625.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bcoqa_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bcoqa_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bcoqa_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/arbitropy/bcoqa-mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_pipeline_en.md new file mode 100644 index 00000000000000..21a9e21c960c5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bcoqa_mt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bcoqa_mt5_pipeline pipeline T5Transformer from arbitropy +author: John Snow Labs +name: bcoqa_mt5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bcoqa_mt5_pipeline` is a English model originally trained by arbitropy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bcoqa_mt5_pipeline_en_5.4.2_3.0_1724440127703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bcoqa_mt5_pipeline_en_5.4.2_3.0_1724440127703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bcoqa_mt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bcoqa_mt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bcoqa_mt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/arbitropy/bcoqa-mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_en.md b/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_en.md new file mode 100644 index 00000000000000..9bbb0976654779 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bdp_summarization_t7 T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t7 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t7` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t7_en_5.4.2_3.0_1724455617786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t7_en_5.4.2_3.0_1724455617786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bdp_summarization_t7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bdp_summarization_t7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_pipeline_en.md new file mode 100644 index 00000000000000..0c3959bb490107 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bdp_summarization_t7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bdp_summarization_t7_pipeline pipeline T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t7_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t7_pipeline` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t7_pipeline_en_5.4.2_3.0_1724455635213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t7_pipeline_en_5.4.2_3.0_1724455635213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bdp_summarization_t7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bdp_summarization_t7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_en.md b/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_en.md new file mode 100644 index 00000000000000..17fa341a37af2f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bikes_multi_t5_small_14 T5Transformer from neal61 +author: John Snow Labs +name: bikes_multi_t5_small_14 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_multi_t5_small_14` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_multi_t5_small_14_en_5.4.2_3.0_1724454397592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_multi_t5_small_14_en_5.4.2_3.0_1724454397592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bikes_multi_t5_small_14","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bikes_multi_t5_small_14", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_multi_t5_small_14| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/neal61/bikes-multi-t5-small-14 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_pipeline_en.md new file mode 100644 index 00000000000000..9e3183e75c2b96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bikes_multi_t5_small_14_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bikes_multi_t5_small_14_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: bikes_multi_t5_small_14_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_multi_t5_small_14_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_multi_t5_small_14_pipeline_en_5.4.2_3.0_1724454415435.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_multi_t5_small_14_pipeline_en_5.4.2_3.0_1724454415435.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bikes_multi_t5_small_14_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bikes_multi_t5_small_14_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_multi_t5_small_14_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/neal61/bikes-multi-t5-small-14 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_en.md b/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_en.md new file mode 100644 index 00000000000000..251f6f42fb7b23 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_plus_base_mol_instructions_molecule T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_base_mol_instructions_molecule +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_base_mol_instructions_molecule` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_base_mol_instructions_molecule_en_5.4.2_3.0_1724420600598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_base_mol_instructions_molecule_en_5.4.2_3.0_1724420600598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_plus_base_mol_instructions_molecule","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_plus_base_mol_instructions_molecule", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_base_mol_instructions_molecule| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-base-mol-instructions-molecule \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_pipeline_en.md new file mode 100644 index 00000000000000..cbdf78ed43d4ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-biot5_plus_base_mol_instructions_molecule_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_plus_base_mol_instructions_molecule_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_base_mol_instructions_molecule_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_base_mol_instructions_molecule_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_base_mol_instructions_molecule_pipeline_en_5.4.2_3.0_1724420655611.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_base_mol_instructions_molecule_pipeline_en_5.4.2_3.0_1724420655611.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_plus_base_mol_instructions_molecule_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_plus_base_mol_instructions_molecule_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_base_mol_instructions_molecule_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-base-mol-instructions-molecule + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_en.md b/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_en.md new file mode 100644 index 00000000000000..c7f04fd72211be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English blog_title_generator T5Transformer from moizumi +author: John Snow Labs +name: blog_title_generator +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`blog_title_generator` is a English model originally trained by moizumi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/blog_title_generator_en_5.4.2_3.0_1724451183620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/blog_title_generator_en_5.4.2_3.0_1724451183620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("blog_title_generator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("blog_title_generator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|blog_title_generator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/moizumi/blog-title-generator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_pipeline_en.md new file mode 100644 index 00000000000000..03143c779cf217 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-blog_title_generator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English blog_title_generator_pipeline pipeline T5Transformer from moizumi +author: John Snow Labs +name: blog_title_generator_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`blog_title_generator_pipeline` is a English model originally trained by moizumi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/blog_title_generator_pipeline_en_5.4.2_3.0_1724451234820.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/blog_title_generator_pipeline_en_5.4.2_3.0_1724451234820.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("blog_title_generator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("blog_title_generator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|blog_title_generator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/moizumi/blog-title-generator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_en.md new file mode 100644 index 00000000000000..4fed052d47a40d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_coolstance7 T5Transformer from coolstance7 +author: John Snow Labs +name: burmese_awesome_billsum_model_coolstance7 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_coolstance7` is a English model originally trained by coolstance7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_coolstance7_en_5.4.2_3.0_1724407167918.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_coolstance7_en_5.4.2_3.0_1724407167918.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_coolstance7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_coolstance7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_coolstance7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/coolstance7/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_pipeline_en.md new file mode 100644 index 00000000000000..803a786f4ed839 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_coolstance7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_coolstance7_pipeline pipeline T5Transformer from coolstance7 +author: John Snow Labs +name: burmese_awesome_billsum_model_coolstance7_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_coolstance7_pipeline` is a English model originally trained by coolstance7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_coolstance7_pipeline_en_5.4.2_3.0_1724407187582.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_coolstance7_pipeline_en_5.4.2_3.0_1724407187582.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_coolstance7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_coolstance7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_coolstance7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/coolstance7/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_en.md new file mode 100644 index 00000000000000..17db749ee27e71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_khakha121 T5Transformer from khakha121 +author: John Snow Labs +name: burmese_awesome_billsum_model_khakha121 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_khakha121` is a English model originally trained by khakha121. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_khakha121_en_5.4.2_3.0_1724450357517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_khakha121_en_5.4.2_3.0_1724450357517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_khakha121","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_khakha121", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_khakha121| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.4 MB| + +## References + +https://huggingface.co/khakha121/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_pipeline_en.md new file mode 100644 index 00000000000000..ab2b565562690d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_khakha121_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_khakha121_pipeline pipeline T5Transformer from khakha121 +author: John Snow Labs +name: burmese_awesome_billsum_model_khakha121_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_khakha121_pipeline` is a English model originally trained by khakha121. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_khakha121_pipeline_en_5.4.2_3.0_1724450378049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_khakha121_pipeline_en_5.4.2_3.0_1724450378049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_khakha121_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_khakha121_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_khakha121_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.4 MB| + +## References + +https://huggingface.co/khakha121/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_en.md new file mode 100644 index 00000000000000..cea865d9d78c43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_szymon T5Transformer from Szymon +author: John Snow Labs +name: burmese_awesome_billsum_model_szymon +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_szymon` is a English model originally trained by Szymon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_szymon_en_5.4.2_3.0_1724435116190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_szymon_en_5.4.2_3.0_1724435116190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_szymon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_szymon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_szymon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.0 MB| + +## References + +https://huggingface.co/Szymon/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_pipeline_en.md new file mode 100644 index 00000000000000..c6d621201cdb58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_szymon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_szymon_pipeline pipeline T5Transformer from Szymon +author: John Snow Labs +name: burmese_awesome_billsum_model_szymon_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_szymon_pipeline` is a English model originally trained by Szymon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_szymon_pipeline_en_5.4.2_3.0_1724435136837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_szymon_pipeline_en_5.4.2_3.0_1724435136837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_szymon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_szymon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_szymon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.0 MB| + +## References + +https://huggingface.co/Szymon/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_en.md new file mode 100644 index 00000000000000..7eb97a3513e36c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_timothytruong T5Transformer from timothytruong +author: John Snow Labs +name: burmese_awesome_billsum_model_timothytruong +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_timothytruong` is a English model originally trained by timothytruong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_timothytruong_en_5.4.2_3.0_1724454374021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_timothytruong_en_5.4.2_3.0_1724454374021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_timothytruong","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_timothytruong", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_timothytruong| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/timothytruong/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_pipeline_en.md new file mode 100644 index 00000000000000..e6eb1a19b96913 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_timothytruong_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_timothytruong_pipeline pipeline T5Transformer from timothytruong +author: John Snow Labs +name: burmese_awesome_billsum_model_timothytruong_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_timothytruong_pipeline` is a English model originally trained by timothytruong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_timothytruong_pipeline_en_5.4.2_3.0_1724454395001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_timothytruong_pipeline_en_5.4.2_3.0_1724454395001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_timothytruong_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_timothytruong_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_timothytruong_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/timothytruong/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_en.md new file mode 100644 index 00000000000000..834ab753dbcca3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_coding_gen T5Transformer from coding-gen +author: John Snow Labs +name: burmese_awesome_opus_books_model_coding_gen +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_coding_gen` is a English model originally trained by coding-gen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_coding_gen_en_5.4.2_3.0_1724454211155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_coding_gen_en_5.4.2_3.0_1724454211155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_coding_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_coding_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_coding_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/coding-gen/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_pipeline_en.md new file mode 100644 index 00000000000000..cfda2307cbc2f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_coding_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_coding_gen_pipeline pipeline T5Transformer from coding-gen +author: John Snow Labs +name: burmese_awesome_opus_books_model_coding_gen_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_coding_gen_pipeline` is a English model originally trained by coding-gen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_coding_gen_pipeline_en_5.4.2_3.0_1724454230235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_coding_gen_pipeline_en_5.4.2_3.0_1724454230235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_coding_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_coding_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_coding_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/coding-gen/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_en.md new file mode 100644 index 00000000000000..fc5c5cd859a117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_strangeman09 T5Transformer from strangeman09 +author: John Snow Labs +name: burmese_awesome_opus_books_model_strangeman09 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_strangeman09` is a English model originally trained by strangeman09. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_strangeman09_en_5.4.2_3.0_1724437900203.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_strangeman09_en_5.4.2_3.0_1724437900203.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_strangeman09","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_strangeman09", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_strangeman09| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.5 MB| + +## References + +https://huggingface.co/strangeman09/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_pipeline_en.md new file mode 100644 index 00000000000000..38bee89acb1b1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_strangeman09_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_strangeman09_pipeline pipeline T5Transformer from strangeman09 +author: John Snow Labs +name: burmese_awesome_opus_books_model_strangeman09_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_strangeman09_pipeline` is a English model originally trained by strangeman09. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_strangeman09_pipeline_en_5.4.2_3.0_1724437919078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_strangeman09_pipeline_en_5.4.2_3.0_1724437919078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_strangeman09_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_strangeman09_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_strangeman09_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.5 MB| + +## References + +https://huggingface.co/strangeman09/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_en.md new file mode 100644 index 00000000000000..21ebfc218cc9ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_sumarize_model_v2 T5Transformer from TheBug95 +author: John Snow Labs +name: burmese_awesome_sumarize_model_v2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_sumarize_model_v2` is a English model originally trained by TheBug95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_sumarize_model_v2_en_5.4.2_3.0_1724407538560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_sumarize_model_v2_en_5.4.2_3.0_1724407538560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_sumarize_model_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_sumarize_model_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_sumarize_model_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.7 MB| + +## References + +https://huggingface.co/TheBug95/my_awesome_sumarize_model_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_pipeline_en.md new file mode 100644 index 00000000000000..00a005d6845f8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_sumarize_model_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_sumarize_model_v2_pipeline pipeline T5Transformer from TheBug95 +author: John Snow Labs +name: burmese_awesome_sumarize_model_v2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_sumarize_model_v2_pipeline` is a English model originally trained by TheBug95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_sumarize_model_v2_pipeline_en_5.4.2_3.0_1724407559111.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_sumarize_model_v2_pipeline_en_5.4.2_3.0_1724407559111.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_sumarize_model_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_sumarize_model_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_sumarize_model_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.7 MB| + +## References + +https://huggingface.co/TheBug95/my_awesome_sumarize_model_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_en.md new file mode 100644 index 00000000000000..345f0ddf514151 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_text_summarization_model T5Transformer from farfalla +author: John Snow Labs +name: burmese_text_summarization_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_text_summarization_model` is a English model originally trained by farfalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_text_summarization_model_en_5.4.2_3.0_1724417063379.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_text_summarization_model_en_5.4.2_3.0_1724417063379.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_text_summarization_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_text_summarization_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_text_summarization_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.0 MB| + +## References + +https://huggingface.co/farfalla/my_text_summarization_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_pipeline_en.md new file mode 100644 index 00000000000000..6a317bb2265a3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_text_summarization_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_text_summarization_model_pipeline pipeline T5Transformer from farfalla +author: John Snow Labs +name: burmese_text_summarization_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_text_summarization_model_pipeline` is a English model originally trained by farfalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_text_summarization_model_pipeline_en_5.4.2_3.0_1724417085475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_text_summarization_model_pipeline_en_5.4.2_3.0_1724417085475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_text_summarization_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_text_summarization_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_text_summarization_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.0 MB| + +## References + +https://huggingface.co/farfalla/my_text_summarization_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_en.md b/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_en.md new file mode 100644 index 00000000000000..e23503ea58b498 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English concat_icl_t0_base T5Transformer from qinyuany +author: John Snow Labs +name: concat_icl_t0_base +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`concat_icl_t0_base` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/concat_icl_t0_base_en_5.4.2_3.0_1724438996679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/concat_icl_t0_base_en_5.4.2_3.0_1724438996679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("concat_icl_t0_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("concat_icl_t0_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|concat_icl_t0_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/qinyuany/concat-icl-t0-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_pipeline_en.md new file mode 100644 index 00000000000000..b4da804a5262e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-concat_icl_t0_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English concat_icl_t0_base_pipeline pipeline T5Transformer from qinyuany +author: John Snow Labs +name: concat_icl_t0_base_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`concat_icl_t0_base_pipeline` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/concat_icl_t0_base_pipeline_en_5.4.2_3.0_1724439043532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/concat_icl_t0_base_pipeline_en_5.4.2_3.0_1724439043532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("concat_icl_t0_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("concat_icl_t0_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|concat_icl_t0_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/qinyuany/concat-icl-t0-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_en.md b/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_en.md new file mode 100644 index 00000000000000..a69658726b8191 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English coref_mem_base_full T5Transformer from eddieman78 +author: John Snow Labs +name: coref_mem_base_full +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`coref_mem_base_full` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/coref_mem_base_full_en_5.4.2_3.0_1724444077338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/coref_mem_base_full_en_5.4.2_3.0_1724444077338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("coref_mem_base_full","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("coref_mem_base_full", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|coref_mem_base_full| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eddieman78/coref-mem-base-full \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_pipeline_en.md new file mode 100644 index 00000000000000..6993b51d2d90d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-coref_mem_base_full_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English coref_mem_base_full_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: coref_mem_base_full_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`coref_mem_base_full_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/coref_mem_base_full_pipeline_en_5.4.2_3.0_1724444126419.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/coref_mem_base_full_pipeline_en_5.4.2_3.0_1724444126419.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("coref_mem_base_full_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("coref_mem_base_full_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|coref_mem_base_full_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eddieman78/coref-mem-base-full + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_en.md new file mode 100644 index 00000000000000..ec023b2297c4e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_asopl T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_asopl +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_asopl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_asopl_en_5.4.2_3.0_1724415693467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_asopl_en_5.4.2_3.0_1724415693467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_asopl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_asopl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_asopl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASOPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_pipeline_en.md new file mode 100644 index 00000000000000..7204f17ab18f56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_asopl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_asopl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_asopl_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_asopl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_asopl_pipeline_en_5.4.2_3.0_1724415875441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_asopl_pipeline_en_5.4.2_3.0_1724415875441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_asopl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_asopl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_asopl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASOPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_en.md new file mode 100644 index 00000000000000..3d5beafe660793 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_opasl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_opasl_v1_h1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_opasl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opasl_v1_h1_en_5.4.2_3.0_1724455255568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opasl_v1_h1_en_5.4.2_3.0_1724455255568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_opasl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_opasl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_opasl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_OPASL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..17c0561c36a6e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline_en_5.4.2_3.0_1724455437219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline_en_5.4.2_3.0_1724455437219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_opasl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_OPASL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_en.md new file mode 100644 index 00000000000000..6fc855ecdf4394 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_sopal_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_sopal_v1_h1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_sopal_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_h1_en_5.4.2_3.0_1724408555974.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_h1_en_5.4.2_3.0_1724408555974.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_sopal_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_sopal_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_sopal_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOPAL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..9d5c0a24b9d5d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline_en_5.4.2_3.0_1724408738346.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline_en_5.4.2_3.0_1724408738346.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_sopal_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOPAL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_en.md new file mode 100644 index 00000000000000..7cd4462c893178 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aposl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aposl_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aposl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aposl_v1_en_5.4.2_3.0_1724452221092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aposl_v1_en_5.4.2_3.0_1724452221092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aposl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aposl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aposl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_APOSL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline_en.md new file mode 100644 index 00000000000000..9b1da160ec8f6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline_en_5.4.2_3.0_1724452402569.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline_en_5.4.2_3.0_1724452402569.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aposl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_APOSL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_en.md new file mode 100644 index 00000000000000..28d806a039df3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_paosl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_paosl_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_paosl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_paosl_v1_en_5.4.2_3.0_1724406467117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_paosl_v1_en_5.4.2_3.0_1724406467117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_paosl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_paosl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_paosl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_PAOSL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline_en.md new file mode 100644 index 00000000000000..a5555b9e891746 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline_en_5.4.2_3.0_1724406676694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline_en_5.4.2_3.0_1724406676694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_paosl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_PAOSL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_en.md b/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_en.md new file mode 100644 index 00000000000000..98464e5a8a0f5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English data_tonga_tonga_islands_text_generation_accelerate T5Transformer from Yvanzhu +author: John Snow Labs +name: data_tonga_tonga_islands_text_generation_accelerate +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`data_tonga_tonga_islands_text_generation_accelerate` is a English model originally trained by Yvanzhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/data_tonga_tonga_islands_text_generation_accelerate_en_5.4.2_3.0_1724437922646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/data_tonga_tonga_islands_text_generation_accelerate_en_5.4.2_3.0_1724437922646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("data_tonga_tonga_islands_text_generation_accelerate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("data_tonga_tonga_islands_text_generation_accelerate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|data_tonga_tonga_islands_text_generation_accelerate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|938.4 MB| + +## References + +https://huggingface.co/Yvanzhu/Data-to-text-generation-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_pipeline_en.md new file mode 100644 index 00000000000000..e4355ece2fec8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-data_tonga_tonga_islands_text_generation_accelerate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English data_tonga_tonga_islands_text_generation_accelerate_pipeline pipeline T5Transformer from Yvanzhu +author: John Snow Labs +name: data_tonga_tonga_islands_text_generation_accelerate_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`data_tonga_tonga_islands_text_generation_accelerate_pipeline` is a English model originally trained by Yvanzhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/data_tonga_tonga_islands_text_generation_accelerate_pipeline_en_5.4.2_3.0_1724437991186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/data_tonga_tonga_islands_text_generation_accelerate_pipeline_en_5.4.2_3.0_1724437991186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("data_tonga_tonga_islands_text_generation_accelerate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("data_tonga_tonga_islands_text_generation_accelerate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|data_tonga_tonga_islands_text_generation_accelerate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|938.5 MB| + +## References + +https://huggingface.co/Yvanzhu/Data-to-text-generation-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-dialot5_en.md b/docs/_posts/ahmedlone127/2024-08-23-dialot5_en.md new file mode 100644 index 00000000000000..4e75ae11b3162a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-dialot5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialot5 T5Transformer from Jaren +author: John Snow Labs +name: dialot5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialot5` is a English model originally trained by Jaren. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialot5_en_5.4.2_3.0_1724451948373.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialot5_en_5.4.2_3.0_1724451948373.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialot5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialot5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialot5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jaren/DialoT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-dialot5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-dialot5_pipeline_en.md new file mode 100644 index 00000000000000..7a9a362cad1d8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-dialot5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialot5_pipeline pipeline T5Transformer from Jaren +author: John Snow Labs +name: dialot5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialot5_pipeline` is a English model originally trained by Jaren. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialot5_pipeline_en_5.4.2_3.0_1724451996322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialot5_pipeline_en_5.4.2_3.0_1724451996322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialot5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialot5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialot5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jaren/DialoT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_en.md new file mode 100644 index 00000000000000..c211c48cfcd90a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_1_en_5.4.2_3.0_1724447998991.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_1_en_5.4.2_3.0_1724447998991.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_pipeline_en.md new file mode 100644 index 00000000000000..7f8c32c3836a31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_0_005_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_1_pipeline_en_5.4.2_3.0_1724448185337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_1_pipeline_en_5.4.2_3.0_1724448185337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_005_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_005_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_en.md new file mode 100644 index 00000000000000..aa6cc33daf331e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_1_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1_0_25 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_0_25_en_5.4.2_3.0_1724450270165.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_0_25_en_5.4.2_3.0_1724450270165.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_1_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_1_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_pipeline_en.md new file mode 100644 index 00000000000000..cc41007c05497b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-distilled_mt5_small_1_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_1_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1_0_25_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_0_25_pipeline_en_5.4.2_3.0_1724450459393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_0_25_pipeline_en_5.4.2_3.0_1724450459393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_1_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_1_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_en.md b/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_en.md new file mode 100644 index 00000000000000..3d1413f7a1b44c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ent5_base_paraphraser_detox T5Transformer from igorktech +author: John Snow Labs +name: ent5_base_paraphraser_detox +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ent5_base_paraphraser_detox` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ent5_base_paraphraser_detox_en_5.4.2_3.0_1724417540775.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ent5_base_paraphraser_detox_en_5.4.2_3.0_1724417540775.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ent5_base_paraphraser_detox","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ent5_base_paraphraser_detox", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ent5_base_paraphraser_detox| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|911.2 MB| + +## References + +https://huggingface.co/igorktech/ent5-base-paraphraser-detox \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_pipeline_en.md new file mode 100644 index 00000000000000..7be72c1147be6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ent5_base_paraphraser_detox_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ent5_base_paraphraser_detox_pipeline pipeline T5Transformer from igorktech +author: John Snow Labs +name: ent5_base_paraphraser_detox_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ent5_base_paraphraser_detox_pipeline` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ent5_base_paraphraser_detox_pipeline_en_5.4.2_3.0_1724417585093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ent5_base_paraphraser_detox_pipeline_en_5.4.2_3.0_1724417585093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ent5_base_paraphraser_detox_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ent5_base_paraphraser_detox_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ent5_base_paraphraser_detox_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|911.2 MB| + +## References + +https://huggingface.co/igorktech/ent5-base-paraphraser-detox + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_nl.md b/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_nl.md new file mode 100644 index 00000000000000..ffc923a74d2864 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_nl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Dutch, Flemish flan_rebel_dutch T5Transformer from Kbrek +author: John Snow Labs +name: flan_rebel_dutch +date: 2024-08-23 +tags: [nl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_rebel_dutch` is a Dutch, Flemish model originally trained by Kbrek. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_rebel_dutch_nl_5.4.2_3.0_1724434988480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_rebel_dutch_nl_5.4.2_3.0_1724434988480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_rebel_dutch","nl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_rebel_dutch", "nl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_rebel_dutch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nl| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Kbrek/flan_rebel_nl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_pipeline_nl.md b/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_pipeline_nl.md new file mode 100644 index 00000000000000..8ee5f252983117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_rebel_dutch_pipeline_nl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Dutch, Flemish flan_rebel_dutch_pipeline pipeline T5Transformer from Kbrek +author: John Snow Labs +name: flan_rebel_dutch_pipeline +date: 2024-08-23 +tags: [nl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_rebel_dutch_pipeline` is a Dutch, Flemish model originally trained by Kbrek. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_rebel_dutch_pipeline_nl_5.4.2_3.0_1724435037076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_rebel_dutch_pipeline_nl_5.4.2_3.0_1724435037076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_rebel_dutch_pipeline", lang = "nl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_rebel_dutch_pipeline", lang = "nl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_rebel_dutch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nl| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Kbrek/flan_rebel_nl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_en.md new file mode 100644 index 00000000000000..1dd6a348646956 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_for_classification T5Transformer from knowledgator +author: John Snow Labs +name: flan_t5_base_for_classification +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_for_classification` is a English model originally trained by knowledgator. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_for_classification_en_5.4.2_3.0_1724423108571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_for_classification_en_5.4.2_3.0_1724423108571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_for_classification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_for_classification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_for_classification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/knowledgator/flan-t5-base-for-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_pipeline_en.md new file mode 100644 index 00000000000000..0262b9805c7252 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_for_classification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_for_classification_pipeline pipeline T5Transformer from knowledgator +author: John Snow Labs +name: flan_t5_base_for_classification_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_for_classification_pipeline` is a English model originally trained by knowledgator. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_for_classification_pipeline_en_5.4.2_3.0_1724423158582.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_for_classification_pipeline_en_5.4.2_3.0_1724423158582.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_for_classification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_for_classification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_for_classification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/knowledgator/flan-t5-base-for-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_en.md new file mode 100644 index 00000000000000..50d6167bfe2cd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_quora_question_answer T5Transformer from toughdata +author: John Snow Labs +name: flan_t5_base_quora_question_answer +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_quora_question_answer` is a English model originally trained by toughdata. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_quora_question_answer_en_5.4.2_3.0_1724423284354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_quora_question_answer_en_5.4.2_3.0_1724423284354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_quora_question_answer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_quora_question_answer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_quora_question_answer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/toughdata/flan-t5-base-quora-question-answer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_pipeline_en.md new file mode 100644 index 00000000000000..983ce1632092e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_quora_question_answer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_quora_question_answer_pipeline pipeline T5Transformer from toughdata +author: John Snow Labs +name: flan_t5_base_quora_question_answer_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_quora_question_answer_pipeline` is a English model originally trained by toughdata. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_quora_question_answer_pipeline_en_5.4.2_3.0_1724423332121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_quora_question_answer_pipeline_en_5.4.2_3.0_1724423332121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_quora_question_answer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_quora_question_answer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_quora_question_answer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/toughdata/flan-t5-base-quora-question-answer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_en.md new file mode 100644 index 00000000000000..80d822e9581aed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_squad_qag T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_base_squad_qag +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_en_5.4.2_3.0_1724426776118.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_en_5.4.2_3.0_1724426776118.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_squad_qag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_squad_qag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lmqg/flan-t5-base-squad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_pipeline_en.md new file mode 100644 index 00000000000000..9b5ee645db050d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_squad_qag_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_squad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_base_squad_qag_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_pipeline_en_5.4.2_3.0_1724426823057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_pipeline_en_5.4.2_3.0_1724426823057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_squad_qag_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_squad_qag_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lmqg/flan-t5-base-squad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_en.md new file mode 100644 index 00000000000000..7e76b70a5be855 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_xerr T5Transformer from tmbdev +author: John Snow Labs +name: flan_t5_base_xerr +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_xerr` is a English model originally trained by tmbdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_xerr_en_5.4.2_3.0_1724450304974.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_xerr_en_5.4.2_3.0_1724450304974.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_xerr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_xerr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_xerr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tmbdev/flan-t5-base-xerr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_pipeline_en.md new file mode 100644 index 00000000000000..952550fa162ddb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_xerr_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_xerr_pipeline pipeline T5Transformer from tmbdev +author: John Snow Labs +name: flan_t5_base_xerr_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_xerr_pipeline` is a English model originally trained by tmbdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_xerr_pipeline_en_5.4.2_3.0_1724450353681.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_xerr_pipeline_en_5.4.2_3.0_1724450353681.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_xerr_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_xerr_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_xerr_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tmbdev/flan-t5-base-xerr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_en.md new file mode 100644 index 00000000000000..216be2e677bb0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_definition_english_base T5Transformer from ltg +author: John Snow Labs +name: flan_t5_definition_english_base +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_definition_english_base` is a English model originally trained by ltg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_definition_english_base_en_5.4.2_3.0_1724433118748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_definition_english_base_en_5.4.2_3.0_1724433118748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_definition_english_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_definition_english_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_definition_english_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ltg/flan-t5-definition-en-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_pipeline_en.md new file mode 100644 index 00000000000000..d42309f5a046bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_definition_english_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_definition_english_base_pipeline pipeline T5Transformer from ltg +author: John Snow Labs +name: flan_t5_definition_english_base_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_definition_english_base_pipeline` is a English model originally trained by ltg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_definition_english_base_pipeline_en_5.4.2_3.0_1724433169344.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_definition_english_base_pipeline_en_5.4.2_3.0_1724433169344.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_definition_english_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_definition_english_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_definition_english_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ltg/flan-t5-definition-en-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_en.md new file mode 100644 index 00000000000000..e4b4aa07db75a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_finetune_rewriter T5Transformer from thangvip +author: John Snow Labs +name: flan_t5_finetune_rewriter +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_finetune_rewriter` is a English model originally trained by thangvip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_finetune_rewriter_en_5.4.2_3.0_1724435456698.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_finetune_rewriter_en_5.4.2_3.0_1724435456698.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_finetune_rewriter","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_finetune_rewriter", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_finetune_rewriter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thangvip/flan-t5-finetune-rewriter \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_pipeline_en.md new file mode 100644 index 00000000000000..42b8376a4931e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_finetune_rewriter_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_finetune_rewriter_pipeline pipeline T5Transformer from thangvip +author: John Snow Labs +name: flan_t5_finetune_rewriter_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_finetune_rewriter_pipeline` is a English model originally trained by thangvip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_finetune_rewriter_pipeline_en_5.4.2_3.0_1724435510084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_finetune_rewriter_pipeline_en_5.4.2_3.0_1724435510084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_finetune_rewriter_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_finetune_rewriter_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_finetune_rewriter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thangvip/flan-t5-finetune-rewriter + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_en.md new file mode 100644 index 00000000000000..368ae4bd439161 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_en_5.4.2_3.0_1724444792024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_en_5.4.2_3.0_1724444792024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_2000-ep6-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..9ec5dda2814c4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline_en_5.4.2_3.0_1724444937624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline_en_5.4.2_3.0_1724444937624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_2000_ep6_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_2000-ep6-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_en.md new file mode 100644 index 00000000000000..1d393a59f643fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_1000_all T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_1000_all +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_1000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_1000_all_en_5.4.2_3.0_1724414461009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_1000_all_en_5.4.2_3.0_1724414461009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_1000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_1000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_1000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_1000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_pipeline_en.md new file mode 100644 index 00000000000000..2499bc7abb40d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_extraction_cnndm_1000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_1000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_1000_all_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_1000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_1000_all_pipeline_en_5.4.2_3.0_1724414607855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_1000_all_pipeline_en_5.4.2_3.0_1724414607855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_1000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_1000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_1000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_1000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_fold_4_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_fold_4_en.md new file mode 100644 index 00000000000000..ef010f6564f6cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_fold_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_fold_4 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_large_fold_4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fold_4` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_4_en_5.4.2_3.0_1724407851805.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_4_en_5.4.2_3.0_1724407851805.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_fold_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_fold_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fold_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-large_fold_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_multiple_choice_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_multiple_choice_en.md new file mode 100644 index 00000000000000..1775870ae66177 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_multiple_choice_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_multiple_choice T5Transformer from lvcalucioli +author: John Snow Labs +name: flan_t5_large_multiple_choice +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_multiple_choice` is a English model originally trained by lvcalucioli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_multiple_choice_en_5.4.2_3.0_1724443138813.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_multiple_choice_en_5.4.2_3.0_1724443138813.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_multiple_choice","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_multiple_choice", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_multiple_choice| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lvcalucioli/flan-t5-large_multiple-choice \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_en.md new file mode 100644 index 00000000000000..5156b7e6e3f13e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_qasem_joint_tokenized T5Transformer from cattana +author: John Snow Labs +name: flan_t5_large_qasem_joint_tokenized +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_qasem_joint_tokenized` is a English model originally trained by cattana. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_qasem_joint_tokenized_en_5.4.2_3.0_1724424702577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_qasem_joint_tokenized_en_5.4.2_3.0_1724424702577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_qasem_joint_tokenized","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_qasem_joint_tokenized", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_qasem_joint_tokenized| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/cattana/flan-t5-large-qasem-joint-tokenized \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_pipeline_en.md new file mode 100644 index 00000000000000..51b6ec115ef0fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_qasem_joint_tokenized_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_qasem_joint_tokenized_pipeline pipeline T5Transformer from cattana +author: John Snow Labs +name: flan_t5_large_qasem_joint_tokenized_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_qasem_joint_tokenized_pipeline` is a English model originally trained by cattana. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_qasem_joint_tokenized_pipeline_en_5.4.2_3.0_1724424841210.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_qasem_joint_tokenized_pipeline_en_5.4.2_3.0_1724424841210.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_qasem_joint_tokenized_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_qasem_joint_tokenized_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_qasem_joint_tokenized_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/cattana/flan-t5-large-qasem-joint-tokenized + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_en.md new file mode 100644 index 00000000000000..1d1d0d57ea236c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_6_3_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_3_xsum +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_3_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_xsum_en_5.4.2_3.0_1724454820499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_xsum_en_5.4.2_3.0_1724454820499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_6_3_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_6_3_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_3_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-3-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_pipeline_en.md new file mode 100644 index 00000000000000..d5d2c88e366939 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_6_3_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_6_3_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_3_xsum_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_3_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_xsum_pipeline_en_5.4.2_3.0_1724454835012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_xsum_pipeline_en_5.4.2_3.0_1724454835012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_6_3_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_6_3_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_3_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-3-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_en.md new file mode 100644 index 00000000000000..9f505b63c59c35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_chnsenticorp T5Transformer from hupenc +author: John Snow Labs +name: flan_t5_small_chnsenticorp +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_chnsenticorp` is a English model originally trained by hupenc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_chnsenticorp_en_5.4.2_3.0_1724408031087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_chnsenticorp_en_5.4.2_3.0_1724408031087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_chnsenticorp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_chnsenticorp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_chnsenticorp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/hupenc/flan-t5-small-ChnSentiCorp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_pipeline_en.md new file mode 100644 index 00000000000000..597f9c865fd383 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_chnsenticorp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_chnsenticorp_pipeline pipeline T5Transformer from hupenc +author: John Snow Labs +name: flan_t5_small_chnsenticorp_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_chnsenticorp_pipeline` is a English model originally trained by hupenc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_chnsenticorp_pipeline_en_5.4.2_3.0_1724408047772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_chnsenticorp_pipeline_en_5.4.2_3.0_1724408047772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_chnsenticorp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_chnsenticorp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_chnsenticorp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/hupenc/flan-t5-small-ChnSentiCorp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_en.md new file mode 100644 index 00000000000000..f7224618e9d9da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samp T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_samp +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samp` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samp_en_5.4.2_3.0_1724456660494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samp_en_5.4.2_3.0_1724456660494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-samp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_pipeline_en.md new file mode 100644 index 00000000000000..c0e2c58ca502bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samp_pipeline pipeline T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_samp_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samp_pipeline` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samp_pipeline_en_5.4.2_3.0_1724456678777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samp_pipeline_en_5.4.2_3.0_1724456678777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-samp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_en.md new file mode 100644 index 00000000000000..02e0365980a4ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_vg_factual_sango_indonesian T5Transformer from lizhuang144 +author: John Snow Labs +name: flan_t5_small_vg_factual_sango_indonesian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_vg_factual_sango_indonesian` is a English model originally trained by lizhuang144. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_vg_factual_sango_indonesian_en_5.4.2_3.0_1724429582476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_vg_factual_sango_indonesian_en_5.4.2_3.0_1724429582476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_vg_factual_sango_indonesian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_vg_factual_sango_indonesian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_vg_factual_sango_indonesian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/lizhuang144/flan-t5-small-VG-factual-sg-id \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_pipeline_en.md new file mode 100644 index 00000000000000..adb0d5e789af9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_vg_factual_sango_indonesian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_vg_factual_sango_indonesian_pipeline pipeline T5Transformer from lizhuang144 +author: John Snow Labs +name: flan_t5_small_vg_factual_sango_indonesian_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_vg_factual_sango_indonesian_pipeline` is a English model originally trained by lizhuang144. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_vg_factual_sango_indonesian_pipeline_en_5.4.2_3.0_1724429599257.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_vg_factual_sango_indonesian_pipeline_en_5.4.2_3.0_1724429599257.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_vg_factual_sango_indonesian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_vg_factual_sango_indonesian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_vg_factual_sango_indonesian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/lizhuang144/flan-t5-small-VG-factual-sg-id + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_fr.md b/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_fr.md new file mode 100644 index 00000000000000..9b55191887f475 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French french_restaurant_mt5_small T5Transformer from NUSTM +author: John Snow Labs +name: french_restaurant_mt5_small +date: 2024-08-23 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_restaurant_mt5_small` is a French model originally trained by NUSTM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_restaurant_mt5_small_fr_5.4.2_3.0_1724437424567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_restaurant_mt5_small_fr_5.4.2_3.0_1724437424567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("french_restaurant_mt5_small","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("french_restaurant_mt5_small", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_restaurant_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NUSTM/french-restaurant-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_pipeline_fr.md new file mode 100644 index 00000000000000..6d0cbffc5788cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-french_restaurant_mt5_small_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French french_restaurant_mt5_small_pipeline pipeline T5Transformer from NUSTM +author: John Snow Labs +name: french_restaurant_mt5_small_pipeline +date: 2024-08-23 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_restaurant_mt5_small_pipeline` is a French model originally trained by NUSTM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_restaurant_mt5_small_pipeline_fr_5.4.2_3.0_1724437609935.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_restaurant_mt5_small_pipeline_fr_5.4.2_3.0_1724437609935.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("french_restaurant_mt5_small_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("french_restaurant_mt5_small_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_restaurant_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NUSTM/french-restaurant-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_en.md b/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_en.md new file mode 100644 index 00000000000000..80a2e701cdc038 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English genlen2ep T5Transformer from Bistolero +author: John Snow Labs +name: genlen2ep +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`genlen2ep` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/genlen2ep_en_5.4.2_3.0_1724416540475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/genlen2ep_en_5.4.2_3.0_1724416540475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("genlen2ep","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("genlen2ep", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|genlen2ep| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/genlen2ep \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_pipeline_en.md new file mode 100644 index 00000000000000..fc082bc9a15c10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-genlen2ep_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English genlen2ep_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: genlen2ep_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`genlen2ep_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/genlen2ep_pipeline_en_5.4.2_3.0_1724416689164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/genlen2ep_pipeline_en_5.4.2_3.0_1724416689164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("genlen2ep_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("genlen2ep_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|genlen2ep_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/genlen2ep + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_en.md b/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_en.md new file mode 100644 index 00000000000000..d7c70ac1430377 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_synthesis_base T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_base +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_base` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_base_en_5.4.2_3.0_1724431389286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_base_en_5.4.2_3.0_1724431389286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_synthesis_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_synthesis_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.5 MB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_pipeline_en.md new file mode 100644 index 00000000000000..3eba2da8684c43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-grammar_synthesis_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_synthesis_base_pipeline pipeline T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_base_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_base_pipeline` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_base_pipeline_en_5.4.2_3.0_1724431448387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_base_pipeline_en_5.4.2_3.0_1724431448387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_synthesis_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_synthesis_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.5 MB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_en.md b/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_en.md new file mode 100644 index 00000000000000..71d0cd51a5b3ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammarcorrectiontransformer T5Transformer from Aminrhmni +author: John Snow Labs +name: grammarcorrectiontransformer +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammarcorrectiontransformer` is a English model originally trained by Aminrhmni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammarcorrectiontransformer_en_5.4.2_3.0_1724419649827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammarcorrectiontransformer_en_5.4.2_3.0_1724419649827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammarcorrectiontransformer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammarcorrectiontransformer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammarcorrectiontransformer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|953.7 MB| + +## References + +https://huggingface.co/Aminrhmni/GrammarCorrectionTransformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_pipeline_en.md new file mode 100644 index 00000000000000..40363abfd72c98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-grammarcorrectiontransformer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammarcorrectiontransformer_pipeline pipeline T5Transformer from Aminrhmni +author: John Snow Labs +name: grammarcorrectiontransformer_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammarcorrectiontransformer_pipeline` is a English model originally trained by Aminrhmni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammarcorrectiontransformer_pipeline_en_5.4.2_3.0_1724419715415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammarcorrectiontransformer_pipeline_en_5.4.2_3.0_1724419715415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammarcorrectiontransformer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammarcorrectiontransformer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammarcorrectiontransformer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|953.7 MB| + +## References + +https://huggingface.co/Aminrhmni/GrammarCorrectionTransformer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_en.md b/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_en.md new file mode 100644 index 00000000000000..dff6b54edcbc7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English hall_of_famers_english_tonga_tonga_islands_cypher T5Transformer from LeviWadd +author: John Snow Labs +name: hall_of_famers_english_tonga_tonga_islands_cypher +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hall_of_famers_english_tonga_tonga_islands_cypher` is a English model originally trained by LeviWadd. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hall_of_famers_english_tonga_tonga_islands_cypher_en_5.4.2_3.0_1724444645961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hall_of_famers_english_tonga_tonga_islands_cypher_en_5.4.2_3.0_1724444645961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("hall_of_famers_english_tonga_tonga_islands_cypher","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("hall_of_famers_english_tonga_tonga_islands_cypher", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hall_of_famers_english_tonga_tonga_islands_cypher| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/LeviWadd/hall_of_famers_english_to_cypher \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_pipeline_en.md new file mode 100644 index 00000000000000..e5e5f0de8e3589 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-hall_of_famers_english_tonga_tonga_islands_cypher_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hall_of_famers_english_tonga_tonga_islands_cypher_pipeline pipeline T5Transformer from LeviWadd +author: John Snow Labs +name: hall_of_famers_english_tonga_tonga_islands_cypher_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hall_of_famers_english_tonga_tonga_islands_cypher_pipeline` is a English model originally trained by LeviWadd. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hall_of_famers_english_tonga_tonga_islands_cypher_pipeline_en_5.4.2_3.0_1724444665329.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hall_of_famers_english_tonga_tonga_islands_cypher_pipeline_en_5.4.2_3.0_1724444665329.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hall_of_famers_english_tonga_tonga_islands_cypher_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hall_of_famers_english_tonga_tonga_islands_cypher_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hall_of_famers_english_tonga_tonga_islands_cypher_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/LeviWadd/hall_of_famers_english_to_cypher + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_en.md b/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_en.md new file mode 100644 index 00000000000000..4ee0e3848f5a4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English inetuned_summarize_test T5Transformer from minnehwg +author: John Snow Labs +name: inetuned_summarize_test +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`inetuned_summarize_test` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/inetuned_summarize_test_en_5.4.2_3.0_1724449373460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/inetuned_summarize_test_en_5.4.2_3.0_1724449373460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("inetuned_summarize_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("inetuned_summarize_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|inetuned_summarize_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/inetuned-summarize-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_pipeline_en.md new file mode 100644 index 00000000000000..870f417a96b8b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-inetuned_summarize_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English inetuned_summarize_test_pipeline pipeline T5Transformer from minnehwg +author: John Snow Labs +name: inetuned_summarize_test_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`inetuned_summarize_test_pipeline` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/inetuned_summarize_test_pipeline_en_5.4.2_3.0_1724449425312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/inetuned_summarize_test_pipeline_en_5.4.2_3.0_1724449425312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("inetuned_summarize_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("inetuned_summarize_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|inetuned_summarize_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/inetuned-summarize-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_en.md b/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_en.md new file mode 100644 index 00000000000000..f78f7876fef65a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_en.md @@ -0,0 +1,98 @@ +--- +layout: model +title: English intent_recognition DistilBertForSequenceClassification from alibidaran +author: John Snow Labs +name: intent_recognition +date: 2024-08-23 +tags: [bert, en, open_source, sequence_classification, onnx] +task: Text Classification +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained DistilBertForSequenceClassification model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`intent_recognition` is a English model originally trained by alibidaran. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/intent_recognition_en_5.4.2_3.0_1724426498527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/intent_recognition_en_5.4.2_3.0_1724426498527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +document_assembler = DocumentAssembler()\ + .setInputCol("text")\ + .setOutputCol("document") + +tokenizer = Tokenizer()\ + .setInputCols("document")\ + .setOutputCol("token") + +sequenceClassifier = DistilBertForSequenceClassification.pretrained("intent_recognition","en")\ + .setInputCols(["document","token"])\ + .setOutputCol("class") + +pipeline = Pipeline().setStages([document_assembler, tokenizer, sequenceClassifier]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val document_assembler = new DocumentAssembler() + .setInputCol("text") + .setOutputCol("document") + +val tokenizer = new Tokenizer() + .setInputCols("document") + .setOutputCol("token") + +val sequenceClassifier = DistilBertForSequenceClassification.pretrained("intent_recognition","en") + .setInputCols(Array("document","token")) + .setOutputCol("class") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, tokenizer, sequenceClassifier)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|intent_recognition| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +References + +https://huggingface.co/alibidaran/intent_recognition \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_pipeline_en.md new file mode 100644 index 00000000000000..b381e9e07af462 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-intent_recognition_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English intent_recognition_pipeline pipeline T5Transformer from Vinitrajputt +author: John Snow Labs +name: intent_recognition_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`intent_recognition_pipeline` is a English model originally trained by Vinitrajputt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/intent_recognition_pipeline_en_5.4.2_3.0_1724426548365.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/intent_recognition_pipeline_en_5.4.2_3.0_1724426548365.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("intent_recognition_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("intent_recognition_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|intent_recognition_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vinitrajputt/intent_recognition + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_it.md b/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_it.md new file mode 100644 index 00000000000000..b25754ed2cac31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica T5Transformer from gsarti +author: John Snow Labs +name: it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica +date: 2024-08-23 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_it_5.4.2_3.0_1724437196848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_it_5.4.2_3.0_1724437196848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|654.8 MB| + +## References + +https://huggingface.co/gsarti/it5-efficient-small-el32-ilgiornale-to-repubblica \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline_it.md new file mode 100644 index 00000000000000..7e1a4120d5b8e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline pipeline T5Transformer from gsarti +author: John Snow Labs +name: it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline +date: 2024-08-23 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline_it_5.4.2_3.0_1724437228151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline_it_5.4.2_3.0_1724437228151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32_ilgiornale_tonga_tonga_islands_repubblica_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|654.8 MB| + +## References + +https://huggingface.co/gsarti/it5-efficient-small-el32-ilgiornale-to-repubblica + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_en.md b/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_en.md new file mode 100644 index 00000000000000..f79f41f92b5d96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_en_5.4.2_3.0_1724419269919.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_en_5.4.2_3.0_1724419269919.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|956.9 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-neg-neut-combined \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline_en.md new file mode 100644 index 00000000000000..3efd5ef6a3e964 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline_en_5.4.2_3.0_1724419320532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline_en_5.4.2_3.0_1724419320532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_combined_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|956.9 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-neg-neut-combined + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-k2t_third_en.md b/docs/_posts/ahmedlone127/2024-08-23-k2t_third_en.md new file mode 100644 index 00000000000000..1c62b5008683d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-k2t_third_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_third T5Transformer from taewhan +author: John Snow Labs +name: k2t_third +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_third` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_third_en_5.4.2_3.0_1724414452517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_third_en_5.4.2_3.0_1724414452517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_third","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_third", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_third| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.0 MB| + +## References + +https://huggingface.co/taewhan/k2t-third \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-k2t_third_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-k2t_third_pipeline_en.md new file mode 100644 index 00000000000000..c092610fd75141 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-k2t_third_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_third_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_third_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_third_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_third_pipeline_en_5.4.2_3.0_1724414471177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_third_pipeline_en_5.4.2_3.0_1724414471177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_third_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_third_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_third_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.0 MB| + +## References + +https://huggingface.co/taewhan/k2t-third + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_en.md new file mode 100644 index 00000000000000..40cbdb11d14545 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English keyword_generator_1 T5Transformer from lucazed +author: John Snow Labs +name: keyword_generator_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`keyword_generator_1` is a English model originally trained by lucazed. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/keyword_generator_1_en_5.4.2_3.0_1724447446151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/keyword_generator_1_en_5.4.2_3.0_1724447446151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("keyword_generator_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("keyword_generator_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|keyword_generator_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lucazed/keyword-generator-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_pipeline_en.md new file mode 100644 index 00000000000000..852f710adb8681 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-keyword_generator_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English keyword_generator_1_pipeline pipeline T5Transformer from lucazed +author: John Snow Labs +name: keyword_generator_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`keyword_generator_1_pipeline` is a English model originally trained by lucazed. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/keyword_generator_1_pipeline_en_5.4.2_3.0_1724447495337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/keyword_generator_1_pipeline_en_5.4.2_3.0_1724447495337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("keyword_generator_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("keyword_generator_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|keyword_generator_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lucazed/keyword-generator-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_en.md b/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_en.md new file mode 100644 index 00000000000000..718c9e6196d3f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kgt5_wikikg90mv2 T5Transformer from apoorvumang +author: John Snow Labs +name: kgt5_wikikg90mv2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kgt5_wikikg90mv2` is a English model originally trained by apoorvumang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kgt5_wikikg90mv2_en_5.4.2_3.0_1724427449259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kgt5_wikikg90mv2_en_5.4.2_3.0_1724427449259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kgt5_wikikg90mv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kgt5_wikikg90mv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kgt5_wikikg90mv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/apoorvumang/kgt5-wikikg90mv2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_pipeline_en.md new file mode 100644 index 00000000000000..c6d53e8d78bce1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kgt5_wikikg90mv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kgt5_wikikg90mv2_pipeline pipeline T5Transformer from apoorvumang +author: John Snow Labs +name: kgt5_wikikg90mv2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kgt5_wikikg90mv2_pipeline` is a English model originally trained by apoorvumang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kgt5_wikikg90mv2_pipeline_en_5.4.2_3.0_1724427466115.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kgt5_wikikg90mv2_pipeline_en_5.4.2_3.0_1724427466115.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kgt5_wikikg90mv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kgt5_wikikg90mv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kgt5_wikikg90mv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/apoorvumang/kgt5-wikikg90mv2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_en.md new file mode 100644 index 00000000000000..99718e04897dbb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_poasl_v6 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_poasl_v6 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_poasl_v6` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_v6_en_5.4.2_3.0_1724408795164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_v6_en_5.4.2_3.0_1724408795164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_poasl_v6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_poasl_v6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_poasl_v6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POASL_v6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_pipeline_en.md new file mode 100644 index 00000000000000..9f8b43f6d67f32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_poasl_v6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_poasl_v6_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_poasl_v6_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_poasl_v6_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_v6_pipeline_en_5.4.2_3.0_1724408965465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_v6_pipeline_en_5.4.2_3.0_1724408965465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_poasl_v6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_poasl_v6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_poasl_v6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POASL_v6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_posal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_posal_v3_en.md new file mode 100644 index 00000000000000..adb234b7e98cb0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_posal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_posal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_posal_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_posal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v3_en_5.4.2_3.0_1724416073697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v3_en_5.4.2_3.0_1724416073697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_posal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POSAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_en.md new file mode 100644 index 00000000000000..e1f84116b0a392 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_pasol_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_pasol_v4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_pasol_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v4_en_5.4.2_3.0_1724450933457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v4_en_5.4.2_3.0_1724450933457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_pasol_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_pasol_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_pasol_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PASOL_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_pipeline_en.md new file mode 100644 index 00000000000000..d6302cc0031a55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_pasol_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_pasol_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_pasol_v4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_pasol_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v4_pipeline_en_5.4.2_3.0_1724451113989.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v4_pipeline_en_5.4.2_3.0_1724451113989.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_pasol_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_pasol_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_pasol_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PASOL_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_en.md b/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_en.md new file mode 100644 index 00000000000000..3bcb62b8868681 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kw2t_wishes T5Transformer from 13on +author: John Snow Labs +name: kw2t_wishes +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kw2t_wishes` is a English model originally trained by 13on. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kw2t_wishes_en_5.4.2_3.0_1724434171600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kw2t_wishes_en_5.4.2_3.0_1724434171600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kw2t_wishes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kw2t_wishes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kw2t_wishes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/13on/kw2t-wishes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_pipeline_en.md new file mode 100644 index 00000000000000..8413a755310f13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kw2t_wishes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kw2t_wishes_pipeline pipeline T5Transformer from 13on +author: John Snow Labs +name: kw2t_wishes_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kw2t_wishes_pipeline` is a English model originally trained by 13on. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kw2t_wishes_pipeline_en_5.4.2_3.0_1724434371327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kw2t_wishes_pipeline_en_5.4.2_3.0_1724434371327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kw2t_wishes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kw2t_wishes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kw2t_wishes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/13on/kw2t-wishes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-l_pretrain_ep2_en.md b/docs/_posts/ahmedlone127/2024-08-23-l_pretrain_ep2_en.md new file mode 100644 index 00000000000000..847d9b193612d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-l_pretrain_ep2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English l_pretrain_ep2 T5Transformer from Amber +author: John Snow Labs +name: l_pretrain_ep2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`l_pretrain_ep2` is a English model originally trained by Amber. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/l_pretrain_ep2_en_5.4.2_3.0_1724425702949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/l_pretrain_ep2_en_5.4.2_3.0_1724425702949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("l_pretrain_ep2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("l_pretrain_ep2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|l_pretrain_ep2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Amber/L_pretrain_ep2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_en.md new file mode 100644 index 00000000000000..2cc49a0242a3a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_en_5.4.2_3.0_1724454584164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_en_5.4.2_3.0_1724454584164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.8 MB| + +## References + +https://huggingface.co/Ashreen/legal-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_german_italian_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_german_italian_en.md new file mode 100644 index 00000000000000..819100f5ff1c9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_german_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_german_italian T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_german_italian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_german_italian` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_italian_en_5.4.2_3.0_1724457554667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_italian_en_5.4.2_3.0_1724457554667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_german_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_german_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_german_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_de_it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..5ec6a5a8870c0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_pipeline pipeline T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_pipeline` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_pipeline_en_5.4.2_3.0_1724454602135.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_pipeline_en_5.4.2_3.0_1724454602135.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.8 MB| + +## References + +https://huggingface.co/Ashreen/legal-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_en.md new file mode 100644 index 00000000000000..22bf1e3e1f4533 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_german +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_german_en_5.4.2_3.0_1724424633465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_german_en_5.4.2_3.0_1724424633465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|175.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_pipeline_en.md new file mode 100644 index 00000000000000..073e98b34ba609 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_german_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_german_pipeline_en_5.4.2_3.0_1724424691313.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_german_pipeline_en_5.4.2_3.0_1724424691313.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|175.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_en.md new file mode 100644 index 00000000000000..41ca3c3ec0e58e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_french_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_spanish +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_spanish_en_5.4.2_3.0_1724434418574.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_spanish_en_5.4.2_3.0_1724434418574.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_french_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_french_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_pipeline_en.md new file mode 100644 index 00000000000000..61d76d1ade96e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_french_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_french_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_spanish_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_spanish_pipeline_en_5.4.2_3.0_1724434475865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_spanish_pipeline_en_5.4.2_3.0_1724434475865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_french_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_french_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_en.md b/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_en.md new file mode 100644 index 00000000000000..9eb85cac9f0884 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lever_mbpp_codex T5Transformer from niansong1996 +author: John Snow Labs +name: lever_mbpp_codex +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lever_mbpp_codex` is a English model originally trained by niansong1996. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lever_mbpp_codex_en_5.4.2_3.0_1724429192696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lever_mbpp_codex_en_5.4.2_3.0_1724429192696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lever_mbpp_codex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lever_mbpp_codex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lever_mbpp_codex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/niansong1996/lever-mbpp-codex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_pipeline_en.md new file mode 100644 index 00000000000000..4c03a974841ce3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lever_mbpp_codex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lever_mbpp_codex_pipeline pipeline T5Transformer from niansong1996 +author: John Snow Labs +name: lever_mbpp_codex_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lever_mbpp_codex_pipeline` is a English model originally trained by niansong1996. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lever_mbpp_codex_pipeline_en_5.4.2_3.0_1724429351731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lever_mbpp_codex_pipeline_en_5.4.2_3.0_1724429351731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lever_mbpp_codex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lever_mbpp_codex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lever_mbpp_codex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/niansong1996/lever-mbpp-codex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_pipeline_en.md new file mode 100644 index 00000000000000..d0d3d15f2fbb83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_local_base_alex2awesome_pipeline pipeline T5Transformer from alex2awesome +author: John Snow Labs +name: long_t5_local_base_alex2awesome_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_alex2awesome_pipeline` is a English model originally trained by alex2awesome. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_alex2awesome_pipeline_en_5.4.2_3.0_1724406464723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_alex2awesome_pipeline_en_5.4.2_3.0_1724406464723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_local_base_alex2awesome_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_local_base_alex2awesome_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_alex2awesome_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/alex2awesome/long-t5-local-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_en.md b/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_en.md new file mode 100644 index 00000000000000..ddf2ac0b28d0c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English maltese_instruct_absa T5Transformer from Homeskills +author: John Snow Labs +name: maltese_instruct_absa +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maltese_instruct_absa` is a English model originally trained by Homeskills. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maltese_instruct_absa_en_5.4.2_3.0_1724434252887.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maltese_instruct_absa_en_5.4.2_3.0_1724434252887.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("maltese_instruct_absa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("maltese_instruct_absa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maltese_instruct_absa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|958.3 MB| + +## References + +https://huggingface.co/Homeskills/mt_instruct_absa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_pipeline_en.md new file mode 100644 index 00000000000000..e92b60a83c652e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-maltese_instruct_absa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English maltese_instruct_absa_pipeline pipeline T5Transformer from Homeskills +author: John Snow Labs +name: maltese_instruct_absa_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maltese_instruct_absa_pipeline` is a English model originally trained by Homeskills. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maltese_instruct_absa_pipeline_en_5.4.2_3.0_1724434301957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maltese_instruct_absa_pipeline_en_5.4.2_3.0_1724434301957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("maltese_instruct_absa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("maltese_instruct_absa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maltese_instruct_absa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|958.3 MB| + +## References + +https://huggingface.co/Homeskills/mt_instruct_absa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_en.md b/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_en.md new file mode 100644 index 00000000000000..c93bbb42ae50e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English md_mt5_1911_v10 T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1911_v10 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1911_v10` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v10_en_5.4.2_3.0_1724407157330.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v10_en_5.4.2_3.0_1724407157330.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("md_mt5_1911_v10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("md_mt5_1911_v10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1911_v10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1911_v10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_pipeline_en.md new file mode 100644 index 00000000000000..90bf1901aa4316 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-md_mt5_1911_v10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English md_mt5_1911_v10_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1911_v10_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1911_v10_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v10_pipeline_en_5.4.2_3.0_1724407321862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v10_pipeline_en_5.4.2_3.0_1724407321862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("md_mt5_1911_v10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("md_mt5_1911_v10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1911_v10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1911_v10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_en.md b/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_en.md new file mode 100644 index 00000000000000..319c459e663b12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English medication_single_t5 T5Transformer from austin +author: John Snow Labs +name: medication_single_t5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medication_single_t5` is a English model originally trained by austin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medication_single_t5_en_5.4.2_3.0_1724418133398.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medication_single_t5_en_5.4.2_3.0_1724418133398.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("medication_single_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("medication_single_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medication_single_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.4 MB| + +## References + +https://huggingface.co/austin/medication-single-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_pipeline_en.md new file mode 100644 index 00000000000000..e74c54df61ac1d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-medication_single_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English medication_single_t5_pipeline pipeline T5Transformer from austin +author: John Snow Labs +name: medication_single_t5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medication_single_t5_pipeline` is a English model originally trained by austin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medication_single_t5_pipeline_en_5.4.2_3.0_1724418149729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medication_single_t5_pipeline_en_5.4.2_3.0_1724418149729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("medication_single_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("medication_single_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medication_single_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.4 MB| + +## References + +https://huggingface.co/austin/medication-single-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_en.md b/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_en.md new file mode 100644 index 00000000000000..940f43b9760eea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English models_rchen413 T5Transformer from rchen413 +author: John Snow Labs +name: models_rchen413 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`models_rchen413` is a English model originally trained by rchen413. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/models_rchen413_en_5.4.2_3.0_1724409658277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/models_rchen413_en_5.4.2_3.0_1724409658277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("models_rchen413","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("models_rchen413", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|models_rchen413| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.1 MB| + +## References + +https://huggingface.co/rchen413/models \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_pipeline_en.md new file mode 100644 index 00000000000000..a7bcb8b16043e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-models_rchen413_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English models_rchen413_pipeline pipeline T5Transformer from rchen413 +author: John Snow Labs +name: models_rchen413_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`models_rchen413_pipeline` is a English model originally trained by rchen413. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/models_rchen413_pipeline_en_5.4.2_3.0_1724409680961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/models_rchen413_pipeline_en_5.4.2_3.0_1724409680961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("models_rchen413_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("models_rchen413_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|models_rchen413_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.1 MB| + +## References + +https://huggingface.co/rchen413/models + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_en.md b/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_en.md new file mode 100644 index 00000000000000..dd799323447e8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_base_caption2smiles T5Transformer from laituan245 +author: John Snow Labs +name: molt5_base_caption2smiles +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_caption2smiles` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_caption2smiles_en_5.4.2_3.0_1724424268713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_caption2smiles_en_5.4.2_3.0_1724424268713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_base_caption2smiles","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_base_caption2smiles", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_caption2smiles| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laituan245/molt5-base-caption2smiles \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_pipeline_en.md new file mode 100644 index 00000000000000..bf43b8fad05e60 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-molt5_base_caption2smiles_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_base_caption2smiles_pipeline pipeline T5Transformer from laituan245 +author: John Snow Labs +name: molt5_base_caption2smiles_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_caption2smiles_pipeline` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_caption2smiles_pipeline_en_5.4.2_3.0_1724424335793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_caption2smiles_pipeline_en_5.4.2_3.0_1724424335793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_base_caption2smiles_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_base_caption2smiles_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_caption2smiles_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laituan245/molt5-base-caption2smiles + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-msmarco_vietnamese_mt5_base_v1_vi.md b/docs/_posts/ahmedlone127/2024-08-23-msmarco_vietnamese_mt5_base_v1_vi.md new file mode 100644 index 00000000000000..a1fdbd5c737df8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-msmarco_vietnamese_mt5_base_v1_vi.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Vietnamese msmarco_vietnamese_mt5_base_v1 T5Transformer from doc2query +author: John Snow Labs +name: msmarco_vietnamese_mt5_base_v1 +date: 2024-08-23 +tags: [vi, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: vi +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_vietnamese_mt5_base_v1` is a Vietnamese model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_vietnamese_mt5_base_v1_vi_5.4.2_3.0_1724424495867.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_vietnamese_mt5_base_v1_vi_5.4.2_3.0_1724424495867.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msmarco_vietnamese_mt5_base_v1","vi") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msmarco_vietnamese_mt5_base_v1", "vi") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_vietnamese_mt5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|vi| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-vietnamese-mt5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_csfd_slovak_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_csfd_slovak_en.md new file mode 100644 index 00000000000000..f73e89d34553f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_csfd_slovak_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_csfd_slovak T5Transformer from gaussalgo +author: John Snow Labs +name: mt5_base_csfd_slovak +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_csfd_slovak` is a English model originally trained by gaussalgo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_csfd_slovak_en_5.4.2_3.0_1724414368429.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_csfd_slovak_en_5.4.2_3.0_1724414368429.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_csfd_slovak","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_csfd_slovak", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_csfd_slovak| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/gaussalgo/mt5-base_CSFD-sk \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_es.md new file mode 100644 index 00000000000000..c5ac7ff93924c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_esquad_qag T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qag +date: 2024-08-23 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qag` is a Castilian, Spanish model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_es_5.4.2_3.0_1724408901600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_es_5.4.2_3.0_1724408901600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qag","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qag", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_pipeline_es.md new file mode 100644 index 00000000000000..3950ceb3bf7a90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qag_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_esquad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qag_pipeline +date: 2024-08-23 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qag_pipeline` is a Castilian, Spanish model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_pipeline_es_5.4.2_3.0_1724409043709.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_pipeline_es_5.4.2_3.0_1724409043709.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qag_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qag_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_en.md new file mode 100644 index 00000000000000..339c8357c7f1d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_30000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_30000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_30000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_30000_en_5.4.2_3.0_1724445267620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_30000_en_5.4.2_3.0_1724445267620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.9 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_pipeline_en.md new file mode 100644 index 00000000000000..2895a696bf4f31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_esquad_qg_trimmed_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_30000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_30000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_30000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724445314184.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724445314184.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qg_trimmed_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qg_trimmed_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.9 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_en.md new file mode 100644 index 00000000000000..84db5a166de453 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_60000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_60000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_60000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_60000_en_5.4.2_3.0_1724417019413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_60000_en_5.4.2_3.0_1724417019413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_pipeline_en.md new file mode 100644 index 00000000000000..cfb79c77c27596 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_frquad_qg_trimmed_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_60000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_60000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_60000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_60000_pipeline_en_5.4.2_3.0_1724417086669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_60000_pipeline_en_5.4.2_3.0_1724417086669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_qg_trimmed_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_qg_trimmed_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_it.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_it.md new file mode 100644 index 00000000000000..a7a882ba367933 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_base_itquad_qag T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_itquad_qag +date: 2024-08-23 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_itquad_qag` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_qag_it_5.4.2_3.0_1724406817303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_qag_it_5.4.2_3.0_1724406817303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_itquad_qag","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_itquad_qag", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_itquad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-itquad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_pipeline_it.md new file mode 100644 index 00000000000000..1738b3ce7fa7ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_itquad_qag_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_base_itquad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_itquad_qag_pipeline +date: 2024-08-23 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_itquad_qag_pipeline` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_qag_pipeline_it_5.4.2_3.0_1724406980792.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_qag_pipeline_it_5.4.2_3.0_1724406980792.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_itquad_qag_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_itquad_qag_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_itquad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-itquad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..42fcfa663b2b21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_jaquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_jaquad_ae_trimmed_50000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_jaquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_jaquad_ae_trimmed_50000_en_5.4.2_3.0_1724452477518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_jaquad_ae_trimmed_50000_en_5.4.2_3.0_1724452477518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_jaquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_jaquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_jaquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-jaquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..08a388aea03a21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_jaquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_jaquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_jaquad_ae_trimmed_50000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_jaquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_jaquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724452533627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_jaquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724452533627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_jaquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_jaquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_jaquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-jaquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_mtolgakbaba_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_mtolgakbaba_en.md new file mode 100644 index 00000000000000..611ccf2466e745 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_mtolgakbaba_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_mtolgakbaba T5Transformer from mtolgakbaba +author: John Snow Labs +name: mt5_base_mtolgakbaba +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_mtolgakbaba` is a English model originally trained by mtolgakbaba. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_mtolgakbaba_en_5.4.2_3.0_1724412662323.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_mtolgakbaba_en_5.4.2_3.0_1724412662323.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_mtolgakbaba","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_mtolgakbaba", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_mtolgakbaba| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/mtolgakbaba/mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_en.md new file mode 100644 index 00000000000000..f51624233b94bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_german_30000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_30000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_30000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_30000_en_5.4.2_3.0_1724445286677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_30000_en_5.4.2_3.0_1724445286677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|513.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_pipeline_en.md new file mode 100644 index 00000000000000..18f65bfd47b3bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_german_30000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_30000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_30000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_30000_pipeline_en_5.4.2_3.0_1724445460425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_30000_pipeline_en_5.4.2_3.0_1724445460425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|513.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_en.md new file mode 100644 index 00000000000000..6edd46a86ca8bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_german_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_75000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_75000_en_5.4.2_3.0_1724454337450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_75000_en_5.4.2_3.0_1724454337450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_pipeline_en.md new file mode 100644 index 00000000000000..6591edd2dc42ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_german_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_75000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_75000_pipeline_en_5.4.2_3.0_1724454584281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_75000_pipeline_en_5.4.2_3.0_1724454584281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_en.md new file mode 100644 index 00000000000000..77e5c8a7f969d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_italian T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_en_5.4.2_3.0_1724435752499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_en_5.4.2_3.0_1724435752499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|870.2 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_pipeline_en.md new file mode 100644 index 00000000000000..0d72f3ef61efda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_pipeline_en_5.4.2_3.0_1724436050938.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_pipeline_en_5.4.2_3.0_1724436050938.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|870.2 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_en.md new file mode 100644 index 00000000000000..31a049122bd14c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_en_5.4.2_3.0_1724452278091.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_en_5.4.2_3.0_1724452278091.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|958.4 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_pipeline_en.md new file mode 100644 index 00000000000000..4091b2277afb77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_pipeline_en_5.4.2_3.0_1724452601195.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_pipeline_en_5.4.2_3.0_1724452601195.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|958.4 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_en.md new file mode 100644 index 00000000000000..2c4e168549fda1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_twi_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_english_twi_news +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_twi_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_twi_news_en_5.4.2_3.0_1724445423718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_twi_news_en_5.4.2_3.0_1724445423718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_twi_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_twi_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_twi_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_en_twi_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_pipeline_en.md new file mode 100644 index 00000000000000..df21ed9db9939c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_twi_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_english_twi_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: mt5_english_twi_news_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_twi_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_twi_news_pipeline_en_5.4.2_3.0_1724445736761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_twi_news_pipeline_en_5.4.2_3.0_1724445736761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_english_twi_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_english_twi_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_twi_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_en_twi_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_kazakh_english_c_moc_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_kazakh_english_c_moc_en.md new file mode 100644 index 00000000000000..02c892330e57cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_kazakh_english_c_moc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_kazakh_english_c_moc T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_kazakh_english_c_moc +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_kazakh_english_c_moc` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_kazakh_english_c_moc_en_5.4.2_3.0_1724411897919.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_kazakh_english_c_moc_en_5.4.2_3.0_1724411897919.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_kazakh_english_c_moc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_kazakh_english_c_moc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_kazakh_english_c_moc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-kk-en-c_MOC \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_en.md new file mode 100644 index 00000000000000..ba1ed96d3083cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_on_translated_data T5Transformer from mashrabburanov +author: John Snow Labs +name: mt5_on_translated_data +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_on_translated_data` is a English model originally trained by mashrabburanov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_on_translated_data_en_5.4.2_3.0_1724432980092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_on_translated_data_en_5.4.2_3.0_1724432980092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_on_translated_data","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_on_translated_data", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_on_translated_data| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mashrabburanov/mt5_on_translated_data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_pipeline_en.md new file mode 100644 index 00000000000000..e08ed9cb011c5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_on_translated_data_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_on_translated_data_pipeline pipeline T5Transformer from mashrabburanov +author: John Snow Labs +name: mt5_on_translated_data_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_on_translated_data_pipeline` is a English model originally trained by mashrabburanov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_on_translated_data_pipeline_en_5.4.2_3.0_1724433131483.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_on_translated_data_pipeline_en_5.4.2_3.0_1724433131483.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_on_translated_data_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_on_translated_data_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_on_translated_data_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mashrabburanov/mt5_on_translated_data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_en.md new file mode 100644 index 00000000000000..ac2082069f3904 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_py5000 T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py5000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py5000` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py5000_en_5.4.2_3.0_1724441321647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py5000_en_5.4.2_3.0_1724441321647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_py5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_py5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_pipeline_en.md new file mode 100644 index 00000000000000..ff01c5b6ba7529 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_py5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_py5000_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py5000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py5000_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py5000_pipeline_en_5.4.2_3.0_1724441484952.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py5000_pipeline_en_5.4.2_3.0_1724441484952.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_py5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_py5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..e1c406d66b1b6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_dequad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_ae_trimmed_50000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_trimmed_50000_en_5.4.2_3.0_1724439624053.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_trimmed_50000_en_5.4.2_3.0_1724439624053.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_dequad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_dequad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|414.8 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..ae206c0da0fd04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_dequad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_dequad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_ae_trimmed_50000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724439646399.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724439646399.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_dequad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_dequad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|414.8 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_en.md new file mode 100644 index 00000000000000..b62627ff16a2c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_2 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_2` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_2_en_5.4.2_3.0_1724449765459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_2_en_5.4.2_3.0_1724449765459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_pipeline_en.md new file mode 100644 index 00000000000000..81b20154ca558c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_2_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_2_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_2_pipeline_en_5.4.2_3.0_1724449956163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_2_pipeline_en_5.4.2_3.0_1724449956163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_13feb_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_13feb_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_en.md new file mode 100644 index 00000000000000..24c4da3cfba7a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_4 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_4` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_4_en_5.4.2_3.0_1724411445377.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_4_en_5.4.2_3.0_1724411445377.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_pipeline_en.md new file mode 100644 index 00000000000000..646ee8e120c444 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_13feb_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_4_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_4_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_4_pipeline_en_5.4.2_3.0_1724411636418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_4_pipeline_en_5.4.2_3.0_1724411636418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_13feb_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_13feb_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_en.md new file mode 100644 index 00000000000000..3a0cb628c159cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_24feb_3 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24feb_3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24feb_3` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_3_en_5.4.2_3.0_1724456660053.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_3_en_5.4.2_3.0_1724456660053.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_24feb_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_24feb_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24feb_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24feb-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_pipeline_en.md new file mode 100644 index 00000000000000..50662eb14f7328 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24feb_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_24feb_3_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24feb_3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24feb_3_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_3_pipeline_en_5.4.2_3.0_1724456757527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_3_pipeline_en_5.4.2_3.0_1724456757527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_24feb_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_24feb_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24feb_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24feb-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_en.md new file mode 100644 index 00000000000000..86bfd8f5f9fee1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_31jan_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_31jan_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_31jan_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_31jan_1_en_5.4.2_3.0_1724451966432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_31jan_1_en_5.4.2_3.0_1724451966432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_31jan_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_31jan_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_31jan_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-31jan-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_pipeline_en.md new file mode 100644 index 00000000000000..1aa6df39b1d3ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_31jan_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_31jan_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_31jan_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_31jan_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_31jan_1_pipeline_en_5.4.2_3.0_1724452058255.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_31jan_1_pipeline_en_5.4.2_3.0_1724452058255.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_31jan_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_31jan_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_31jan_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-31jan-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_en.md new file mode 100644 index 00000000000000..402790535b994b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_japanese T5Transformer from heskielsvn +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_japanese +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_japanese` is a English model originally trained by heskielsvn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_japanese_en_5.4.2_3.0_1724452430769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_japanese_en_5.4.2_3.0_1724452430769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_japanese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_japanese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_japanese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/heskielsvn/mt5-small-finetuned-amazon-en-ja \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_pipeline_en.md new file mode 100644 index 00000000000000..762302ccc3bbf9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_japanese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_japanese_pipeline pipeline T5Transformer from heskielsvn +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_japanese_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_japanese_pipeline` is a English model originally trained by heskielsvn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_japanese_pipeline_en_5.4.2_3.0_1724452523566.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_japanese_pipeline_en_5.4.2_3.0_1724452523566.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_japanese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_japanese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_japanese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/heskielsvn/mt5-small-finetuned-amazon-en-ja + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_en.md new file mode 100644 index 00000000000000..2b50e1de2875f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_accelerate3 T5Transformer from chisun +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_accelerate3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_accelerate3` is a English model originally trained by chisun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate3_en_5.4.2_3.0_1724453604100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate3_en_5.4.2_3.0_1724453604100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_accelerate3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_accelerate3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_accelerate3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/chisun/mt5-small-finetuned-amazon-en-es-accelerate3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline_en.md new file mode 100644 index 00000000000000..58d37073df8d2a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline pipeline T5Transformer from chisun +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline` is a English model originally trained by chisun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline_en_5.4.2_3.0_1724453755635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline_en_5.4.2_3.0_1724453755635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_accelerate3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/chisun/mt5-small-finetuned-amazon-en-es-accelerate3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_pipeline_en.md new file mode 100644 index 00000000000000..79ac0029139a2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_ep9_pipeline pipeline T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_ep9_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_ep9_pipeline` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ep9_pipeline_en_5.4.2_3.0_1724406455386.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ep9_pipeline_en_5.4.2_3.0_1724406455386.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_ep9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_ep9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_ep9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_en.md new file mode 100644 index 00000000000000..f3179b7030508c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_solmysh T5Transformer from solmysh +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_solmysh +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_solmysh` is a English model originally trained by solmysh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_solmysh_en_5.4.2_3.0_1724450992245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_solmysh_en_5.4.2_3.0_1724450992245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_solmysh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_solmysh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_solmysh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/solmysh/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline_en.md new file mode 100644 index 00000000000000..e1caa6cb9f02ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline pipeline T5Transformer from solmysh +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline` is a English model originally trained by solmysh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline_en_5.4.2_3.0_1724451088577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline_en_5.4.2_3.0_1724451088577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_solmysh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/solmysh/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_en.md new file mode 100644 index 00000000000000..58aa0648ec9f56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_en_5.4.2_3.0_1724417361204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_en_5.4.2_3.0_1724417361204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-ar-to-th-2nd-round \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline_en.md new file mode 100644 index 00000000000000..16a94dcdbb8072 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline pipeline T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline_en_5.4.2_3.0_1724417450230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline_en_5.4.2_3.0_1724417450230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_arabic_tonga_tonga_islands_thai_2nd_round_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-ar-to-th-2nd-round + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_en.md new file mode 100644 index 00000000000000..e38e7ff48053ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_bbc_lemmatized T5Transformer from piyushjain4 +author: John Snow Labs +name: mt5_small_finetuned_bbc_lemmatized +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_bbc_lemmatized` is a English model originally trained by piyushjain4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_bbc_lemmatized_en_5.4.2_3.0_1724439372680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_bbc_lemmatized_en_5.4.2_3.0_1724439372680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_bbc_lemmatized","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_bbc_lemmatized", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_bbc_lemmatized| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/piyushjain4/mt5-small-finetuned-bbc-lemmatized \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_pipeline_en.md new file mode 100644 index 00000000000000..a6e0da14773031 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_bbc_lemmatized_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_bbc_lemmatized_pipeline pipeline T5Transformer from piyushjain4 +author: John Snow Labs +name: mt5_small_finetuned_bbc_lemmatized_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_bbc_lemmatized_pipeline` is a English model originally trained by piyushjain4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_bbc_lemmatized_pipeline_en_5.4.2_3.0_1724439465242.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_bbc_lemmatized_pipeline_en_5.4.2_3.0_1724439465242.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_bbc_lemmatized_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_bbc_lemmatized_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_bbc_lemmatized_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/piyushjain4/mt5-small-finetuned-bbc-lemmatized + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_en.md new file mode 100644 index 00000000000000..e04c14eb44a1f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_head400_100 T5Transformer from mdosama39 +author: John Snow Labs +name: mt5_small_finetuned_head400_100 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_head400_100` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_head400_100_en_5.4.2_3.0_1724456640339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_head400_100_en_5.4.2_3.0_1724456640339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_head400_100","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_head400_100", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_head400_100| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/mdosama39/mt5-small-finetuned-head400_100 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_pipeline_en.md new file mode 100644 index 00000000000000..035dd79ddc94e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_head400_100_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_head400_100_pipeline pipeline T5Transformer from mdosama39 +author: John Snow Labs +name: mt5_small_finetuned_head400_100_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_head400_100_pipeline` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_head400_100_pipeline_en_5.4.2_3.0_1724456814656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_head400_100_pipeline_en_5.4.2_3.0_1724456814656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_head400_100_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_head400_100_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_head400_100_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/mdosama39/mt5-small-finetuned-head400_100 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_en.md new file mode 100644 index 00000000000000..c96f7f1baa4eda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_squad T5Transformer from samyakjain20 +author: John Snow Labs +name: mt5_small_finetuned_squad +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_squad` is a English model originally trained by samyakjain20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_squad_en_5.4.2_3.0_1724417353147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_squad_en_5.4.2_3.0_1724417353147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_squad","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_squad", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_squad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/samyakjain20/mt5-small-finetuned-squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_pipeline_en.md new file mode 100644 index 00000000000000..e718dcaf9182ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_squad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_squad_pipeline pipeline T5Transformer from samyakjain20 +author: John Snow Labs +name: mt5_small_finetuned_squad_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_squad_pipeline` is a English model originally trained by samyakjain20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_squad_pipeline_en_5.4.2_3.0_1724417498118.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_squad_pipeline_en_5.4.2_3.0_1724417498118.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_squad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_squad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_squad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/samyakjain20/mt5-small-finetuned-squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_en.md new file mode 100644 index 00000000000000..36775d24360ee5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_paracrawl_dede T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_dede +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_dede` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_dede_en_5.4.2_3.0_1724432965268.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_dede_en_5.4.2_3.0_1724432965268.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_paracrawl_dede","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_paracrawl_dede", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_dede| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-dede \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_pipeline_en.md new file mode 100644 index 00000000000000..a75c38f6f68e8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_paracrawl_dede_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_paracrawl_dede_pipeline pipeline T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_dede_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_dede_pipeline` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_dede_pipeline_en_5.4.2_3.0_1724433054034.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_dede_pipeline_en_5.4.2_3.0_1724433054034.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_paracrawl_dede_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_paracrawl_dede_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_dede_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-dede + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_en.md new file mode 100644 index 00000000000000..b003dbd9db0709 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_pashto_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_pashto_10k +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_pashto_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_pashto_10k_en_5.4.2_3.0_1724407448808.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_pashto_10k_en_5.4.2_3.0_1724407448808.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_pashto_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_pashto_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_pashto_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ps-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_pipeline_en.md new file mode 100644 index 00000000000000..d2911225e9673d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_pashto_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_pashto_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_pashto_10k_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_pashto_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_pashto_10k_pipeline_en_5.4.2_3.0_1724407623073.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_pashto_10k_pipeline_en_5.4.2_3.0_1724407623073.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_pashto_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_pashto_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_pashto_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ps-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_en.md new file mode 100644 index 00000000000000..ae8ebeb32d27c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_90000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_90000_en_5.4.2_3.0_1724455620066.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_90000_en_5.4.2_3.0_1724455620066.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|621.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_pipeline_en.md new file mode 100644 index 00000000000000..d69a88c248a8bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qa_trimmed_english_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_90000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_90000_pipeline_en_5.4.2_3.0_1724455654671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_90000_pipeline_en_5.4.2_3.0_1724455654671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qa_trimmed_english_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qa_trimmed_english_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|621.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_en.md new file mode 100644 index 00000000000000..3c0de38fec989f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_10000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_10000_en_5.4.2_3.0_1724446259288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_10000_en_5.4.2_3.0_1724446259288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|224.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_pipeline_en.md new file mode 100644 index 00000000000000..a0c519e0ca06c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_squad_qg_trimmed_english_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_10000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_10000_pipeline_en_5.4.2_3.0_1724446270363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_10000_pipeline_en_5.4.2_3.0_1724446270363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qg_trimmed_english_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qg_trimmed_english_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|224.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_en.md new file mode 100644 index 00000000000000..012440dfb04882 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tata_trans_blueprints T5Transformer from adenhaus +author: John Snow Labs +name: mt5_small_tata_trans_blueprints +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tata_trans_blueprints` is a English model originally trained by adenhaus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tata_trans_blueprints_en_5.4.2_3.0_1724453946799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tata_trans_blueprints_en_5.4.2_3.0_1724453946799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tata_trans_blueprints","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tata_trans_blueprints", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tata_trans_blueprints| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adenhaus/mt5-small-tata-trans-blueprints \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_pipeline_en.md new file mode 100644 index 00000000000000..9b1cbc855f2d51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_tata_trans_blueprints_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tata_trans_blueprints_pipeline pipeline T5Transformer from adenhaus +author: John Snow Labs +name: mt5_small_tata_trans_blueprints_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tata_trans_blueprints_pipeline` is a English model originally trained by adenhaus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tata_trans_blueprints_pipeline_en_5.4.2_3.0_1724454146670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tata_trans_blueprints_pipeline_en_5.4.2_3.0_1724454146670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tata_trans_blueprints_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tata_trans_blueprints_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tata_trans_blueprints_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adenhaus/mt5-small-tata-trans-blueprints + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_en.md new file mode 100644 index 00000000000000..2ed7832b20dc6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_translation_english_thai T5Transformer from SuperAI2-Machima +author: John Snow Labs +name: mt5_small_translation_english_thai +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_translation_english_thai` is a English model originally trained by SuperAI2-Machima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_translation_english_thai_en_5.4.2_3.0_1724433946413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_translation_english_thai_en_5.4.2_3.0_1724433946413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_translation_english_thai","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_translation_english_thai", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_translation_english_thai| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/SuperAI2-Machima/mt5-small-translation_english-thai \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_pipeline_en.md new file mode 100644 index 00000000000000..77abc0ad17a29e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_translation_english_thai_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_translation_english_thai_pipeline pipeline T5Transformer from SuperAI2-Machima +author: John Snow Labs +name: mt5_small_translation_english_thai_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_translation_english_thai_pipeline` is a English model originally trained by SuperAI2-Machima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_translation_english_thai_pipeline_en_5.4.2_3.0_1724434038626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_translation_english_thai_pipeline_en_5.4.2_3.0_1724434038626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_translation_english_thai_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_translation_english_thai_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_translation_english_thai_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/SuperAI2-Machima/mt5-small-translation_english-thai + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_en.md new file mode 100644 index 00000000000000..623d39456442fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_enquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_enquad_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_enquad_qg` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_enquad_qg_en_5.4.2_3.0_1724455449638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_enquad_qg_en_5.4.2_3.0_1724455449638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_enquad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_enquad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_enquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-enquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_pipeline_en.md new file mode 100644 index 00000000000000..6ccfa2fa768e74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_enquad_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_enquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_enquad_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_enquad_qg_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_enquad_qg_pipeline_en_5.4.2_3.0_1724455525184.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_enquad_qg_pipeline_en_5.4.2_3.0_1724455525184.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_enquad_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_enquad_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_enquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-enquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_fr.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_fr.md new file mode 100644 index 00000000000000..491449f21fbf7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_5000_frquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000_frquad_qg +date: 2024-08-23 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000_frquad_qg` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qg_fr_5.4.2_3.0_1724437492852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qg_fr_5.4.2_3.0_1724437492852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000_frquad_qg","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000_frquad_qg", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000_frquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|196.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000-frquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_pipeline_fr.md new file mode 100644 index 00000000000000..a238980b5d5b01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_5000_frquad_qg_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_5000_frquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000_frquad_qg_pipeline +date: 2024-08-23 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000_frquad_qg_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qg_pipeline_fr_5.4.2_3.0_1724437503049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qg_pipeline_fr_5.4.2_3.0_1724437503049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_5000_frquad_qg_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_5000_frquad_qg_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000_frquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|196.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000-frquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_pipeline_ru.md new file mode 100644 index 00000000000000..79c3b68ef3b58c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_10000_ruquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_10000_ruquad_qa_pipeline +date: 2024-08-23 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_10000_ruquad_qa_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724417756000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724417756000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_10000_ruquad_qa_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_10000_ruquad_qa_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_10000_ruquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-10000-ruquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_ru.md new file mode 100644 index 00000000000000..cbf7bf7a155109 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_10000_ruquad_qa_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_10000_ruquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_10000_ruquad_qa +date: 2024-08-23 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_10000_ruquad_qa` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qa_ru_5.4.2_3.0_1724417745283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qa_ru_5.4.2_3.0_1724417745283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_10000_ruquad_qa","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_10000_ruquad_qa", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_10000_ruquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-10000-ruquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_pipeline_ru.md new file mode 100644 index 00000000000000..5dcf0aacda265b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_60000_ruquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_60000_ruquad_qa_pipeline +date: 2024-08-23 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_60000_ruquad_qa_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_60000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724448770360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_60000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724448770360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_60000_ruquad_qa_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_60000_ruquad_qa_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_60000_ruquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|468.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-60000-ruquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_ru.md new file mode 100644 index 00000000000000..e12f87261c0461 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_60000_ruquad_qa_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_60000_ruquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_60000_ruquad_qa +date: 2024-08-23 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_60000_ruquad_qa` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_60000_ruquad_qa_ru_5.4.2_3.0_1724448744208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_60000_ruquad_qa_ru_5.4.2_3.0_1724448744208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_60000_ruquad_qa","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_60000_ruquad_qa", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_60000_ruquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|468.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-60000-ruquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_es.md new file mode 100644 index 00000000000000..98a8b47f98c73e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_30000_esquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_30000_esquad_qa +date: 2024-08-23 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_30000_esquad_qa` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qa_es_5.4.2_3.0_1724438919408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qa_es_5.4.2_3.0_1724438919408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_30000_esquad_qa","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_30000_esquad_qa", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_30000_esquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|333.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-30000-esquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_pipeline_es.md new file mode 100644 index 00000000000000..aa94f70dcc5a28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qa_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_30000_esquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_30000_esquad_qa_pipeline +date: 2024-08-23 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_30000_esquad_qa_pipeline` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qa_pipeline_es_5.4.2_3.0_1724438936779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qa_pipeline_es_5.4.2_3.0_1724438936779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_30000_esquad_qa_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_30000_esquad_qa_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_30000_esquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|333.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-30000-esquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_es.md new file mode 100644 index 00000000000000..9a2fcb571108b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_30000_esquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_30000_esquad_qg +date: 2024-08-23 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_30000_esquad_qg` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qg_es_5.4.2_3.0_1724445700321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qg_es_5.4.2_3.0_1724445700321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_30000_esquad_qg","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_30000_esquad_qg", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_30000_esquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|331.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-30000-esquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_pipeline_es.md new file mode 100644 index 00000000000000..d4524e5a816c11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_spanish_30000_esquad_qg_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_30000_esquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_30000_esquad_qg_pipeline +date: 2024-08-23 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_30000_esquad_qg_pipeline` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qg_pipeline_es_5.4.2_3.0_1724445719568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_30000_esquad_qg_pipeline_es_5.4.2_3.0_1724445719568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_30000_esquad_qg_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_30000_esquad_qg_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_30000_esquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|331.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-30000-esquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_en.md new file mode 100644 index 00000000000000..28490d9da60651 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_turkish_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_turkish_10k +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_turkish_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_turkish_10k_en_5.4.2_3.0_1724415145837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_turkish_10k_en_5.4.2_3.0_1724415145837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_turkish_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_turkish_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_turkish_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-tr-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_pipeline_en.md new file mode 100644 index 00000000000000..5f85be8e847d14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_turkish_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_turkish_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_turkish_10k_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_turkish_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_turkish_10k_pipeline_en_5.4.2_3.0_1724415297504.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_turkish_10k_pipeline_en_5.4.2_3.0_1724415297504.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_turkish_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_turkish_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_turkish_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-tr-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_en.md new file mode 100644 index 00000000000000..764ef1ba27e9a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summarize_telugu T5Transformer from aashish-249 +author: John Snow Labs +name: mt5_summarize_telugu +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_telugu` is a English model originally trained by aashish-249. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_telugu_en_5.4.2_3.0_1724436916489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_telugu_en_5.4.2_3.0_1724436916489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summarize_telugu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summarize_telugu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_telugu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/aashish-249/mt5-summarize-te \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_pipeline_en.md new file mode 100644 index 00000000000000..b2f6d01cda09a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_telugu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summarize_telugu_pipeline pipeline T5Transformer from aashish-249 +author: John Snow Labs +name: mt5_summarize_telugu_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_telugu_pipeline` is a English model originally trained by aashish-249. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_telugu_pipeline_en_5.4.2_3.0_1724437032656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_telugu_pipeline_en_5.4.2_3.0_1724437032656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summarize_telugu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summarize_telugu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_telugu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/aashish-249/mt5-summarize-te + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5base_ruparaphraser_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5base_ruparaphraser_en.md new file mode 100644 index 00000000000000..a532e087114b9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5base_ruparaphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5base_ruparaphraser T5Transformer from alenusch +author: John Snow Labs +name: mt5base_ruparaphraser +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5base_ruparaphraser` is a English model originally trained by alenusch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5base_ruparaphraser_en_5.4.2_3.0_1724427487359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5base_ruparaphraser_en_5.4.2_3.0_1724427487359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5base_ruparaphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5base_ruparaphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5base_ruparaphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/alenusch/mt5base-ruparaphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_en.md new file mode 100644 index 00000000000000..9a359d5e2aed68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5s_bi2590 T5Transformer from NaoS2 +author: John Snow Labs +name: mt5s_bi2590 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5s_bi2590` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5s_bi2590_en_5.4.2_3.0_1724416038567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5s_bi2590_en_5.4.2_3.0_1724416038567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5s_bi2590","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5s_bi2590", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5s_bi2590| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/NaoS2/mt5s-bi2590 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_pipeline_en.md new file mode 100644 index 00000000000000..98aa102410d2d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5s_bi2590_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5s_bi2590_pipeline pipeline T5Transformer from NaoS2 +author: John Snow Labs +name: mt5s_bi2590_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5s_bi2590_pipeline` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5s_bi2590_pipeline_en_5.4.2_3.0_1724416182994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5s_bi2590_pipeline_en_5.4.2_3.0_1724416182994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5s_bi2590_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5s_bi2590_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5s_bi2590_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/NaoS2/mt5s-bi2590 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-newt5_en.md b/docs/_posts/ahmedlone127/2024-08-23-newt5_en.md new file mode 100644 index 00000000000000..c8f72c10066dd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-newt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English newt5 T5Transformer from ishwarbb23 +author: John Snow Labs +name: newt5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newt5` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newt5_en_5.4.2_3.0_1724448825613.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newt5_en_5.4.2_3.0_1724448825613.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("newt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("newt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/newt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-newt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-newt5_pipeline_en.md new file mode 100644 index 00000000000000..5f1f8bc1af2f6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-newt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English newt5_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: newt5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newt5_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newt5_pipeline_en_5.4.2_3.0_1724448873507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newt5_pipeline_en_5.4.2_3.0_1724448873507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("newt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("newt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/newt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-nl3_en.md b/docs/_posts/ahmedlone127/2024-08-23-nl3_en.md new file mode 100644 index 00000000000000..a8622bbe8462e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-nl3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nl3 T5Transformer from Bistolero +author: John Snow Labs +name: nl3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nl3` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nl3_en_5.4.2_3.0_1724448089495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nl3_en_5.4.2_3.0_1724448089495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nl3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nl3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nl3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-nl3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-nl3_pipeline_en.md new file mode 100644 index 00000000000000..e628b90dbf155e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-nl3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nl3_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: nl3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nl3_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nl3_pipeline_en_5.4.2_3.0_1724448256762.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nl3_pipeline_en_5.4.2_3.0_1724448256762.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nl3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nl3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nl3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_en.md b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_en.md new file mode 100644 index 00000000000000..9c7c0f307e00b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_en_5.4.2_3.0_1724454317973.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_en_5.4.2_3.0_1724454317973.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.8 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline_en.md new file mode 100644 index 00000000000000..8685f9ceb3ab6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline_en_5.4.2_3.0_1724454335778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline_en_5.4.2_3.0_1724454335778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run1_sheoran95_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.8 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_en.md b/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_en.md new file mode 100644 index 00000000000000..ee0fcbfb4be047 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v5 T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v5` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v5_en_5.4.2_3.0_1724434882615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v5_en_5.4.2_3.0_1724434882615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_pipeline_en.md new file mode 100644 index 00000000000000..3515ab8ba8b1fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-oop_german_qg_flan_t5_base_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v5_pipeline pipeline T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v5_pipeline` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v5_pipeline_en_5.4.2_3.0_1724434937116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v5_pipeline_en_5.4.2_3.0_1724434937116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("oop_german_qg_flan_t5_base_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("oop_german_qg_flan_t5_base_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_en.md b/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_en.md new file mode 100644 index 00000000000000..93fc43579a3b3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English outputs_versae T5Transformer from versae +author: John Snow Labs +name: outputs_versae +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`outputs_versae` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/outputs_versae_en_5.4.2_3.0_1724413982831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/outputs_versae_en_5.4.2_3.0_1724413982831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("outputs_versae","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("outputs_versae", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|outputs_versae| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/outputs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_pipeline_en.md new file mode 100644 index 00000000000000..f0982f5f23961e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-outputs_versae_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English outputs_versae_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: outputs_versae_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`outputs_versae_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/outputs_versae_pipeline_en_5.4.2_3.0_1724414169984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/outputs_versae_pipeline_en_5.4.2_3.0_1724414169984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("outputs_versae_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("outputs_versae_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|outputs_versae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/outputs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_en.md new file mode 100644 index 00000000000000..f877e4ba914e28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English panl_sql_v0_2 T5Transformer from obada-jaras +author: John Snow Labs +name: panl_sql_v0_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`panl_sql_v0_2` is a English model originally trained by obada-jaras. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/panl_sql_v0_2_en_5.4.2_3.0_1724450863553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/panl_sql_v0_2_en_5.4.2_3.0_1724450863553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("panl_sql_v0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("panl_sql_v0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|panl_sql_v0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/obada-jaras/PANL_SQL_v0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_pipeline_en.md new file mode 100644 index 00000000000000..ee25a073d4094b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-panl_sql_v0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English panl_sql_v0_2_pipeline pipeline T5Transformer from obada-jaras +author: John Snow Labs +name: panl_sql_v0_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`panl_sql_v0_2_pipeline` is a English model originally trained by obada-jaras. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/panl_sql_v0_2_pipeline_en_5.4.2_3.0_1724450948061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/panl_sql_v0_2_pipeline_en_5.4.2_3.0_1724450948061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("panl_sql_v0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("panl_sql_v0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|panl_sql_v0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/obada-jaras/PANL_SQL_v0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_en.md b/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_en.md new file mode 100644 index 00000000000000..690f52d0049076 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English paosl_coqe_vit5_large_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: paosl_coqe_vit5_large_v2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paosl_coqe_vit5_large_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paosl_coqe_vit5_large_v2_en_5.4.2_3.0_1724449464462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paosl_coqe_vit5_large_v2_en_5.4.2_3.0_1724449464462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("paosl_coqe_vit5_large_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("paosl_coqe_vit5_large_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paosl_coqe_vit5_large_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/PAOSL_COQE_viT5-large_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_pipeline_en.md new file mode 100644 index 00000000000000..18a9cbefcb1c9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-paosl_coqe_vit5_large_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English paosl_coqe_vit5_large_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: paosl_coqe_vit5_large_v2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paosl_coqe_vit5_large_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paosl_coqe_vit5_large_v2_pipeline_en_5.4.2_3.0_1724449632476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paosl_coqe_vit5_large_v2_pipeline_en_5.4.2_3.0_1724449632476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("paosl_coqe_vit5_large_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("paosl_coqe_vit5_large_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paosl_coqe_vit5_large_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/PAOSL_COQE_viT5-large_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_en.md b/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_en.md new file mode 100644 index 00000000000000..14112815e3c70c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English parrot_paraphraser_on_t5_finetuned_xsum_v5 T5Transformer from MGanesh29 +author: John Snow Labs +name: parrot_paraphraser_on_t5_finetuned_xsum_v5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`parrot_paraphraser_on_t5_finetuned_xsum_v5` is a English model originally trained by MGanesh29. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/parrot_paraphraser_on_t5_finetuned_xsum_v5_en_5.4.2_3.0_1724409351896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/parrot_paraphraser_on_t5_finetuned_xsum_v5_en_5.4.2_3.0_1724409351896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("parrot_paraphraser_on_t5_finetuned_xsum_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("parrot_paraphraser_on_t5_finetuned_xsum_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|parrot_paraphraser_on_t5_finetuned_xsum_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/MGanesh29/parrot_paraphraser_on_T5-finetuned-xsum-v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline_en.md new file mode 100644 index 00000000000000..2992535ff3bd2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline pipeline T5Transformer from MGanesh29 +author: John Snow Labs +name: parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline` is a English model originally trained by MGanesh29. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline_en_5.4.2_3.0_1724409400396.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline_en_5.4.2_3.0_1724409400396.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|parrot_paraphraser_on_t5_finetuned_xsum_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/MGanesh29/parrot_paraphraser_on_T5-finetuned-xsum-v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_en.md b/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_en.md new file mode 100644 index 00000000000000..76384860e3504c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English polish_transliterator_test2 T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator_test2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator_test2` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_test2_en_5.4.2_3.0_1724409564823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_test2_en_5.4.2_3.0_1724409564823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polish_transliterator_test2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polish_transliterator_test2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator_test2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|925.5 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator_test2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_pipeline_en.md new file mode 100644 index 00000000000000..079df68c6503a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-polish_transliterator_test2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English polish_transliterator_test2_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator_test2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator_test2_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_test2_pipeline_en_5.4.2_3.0_1724409637198.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_test2_pipeline_en_5.4.2_3.0_1724409637198.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polish_transliterator_test2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polish_transliterator_test2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator_test2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|925.5 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator_test2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_en.md b/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_en.md new file mode 100644 index 00000000000000..3cf1bb5bcf1834 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pst5_tajik_persian_farsi_bidirectional T5Transformer from TurkLangsTeamURFU +author: John Snow Labs +name: pst5_tajik_persian_farsi_bidirectional +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pst5_tajik_persian_farsi_bidirectional` is a English model originally trained by TurkLangsTeamURFU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pst5_tajik_persian_farsi_bidirectional_en_5.4.2_3.0_1724455149466.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pst5_tajik_persian_farsi_bidirectional_en_5.4.2_3.0_1724455149466.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pst5_tajik_persian_farsi_bidirectional","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pst5_tajik_persian_farsi_bidirectional", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pst5_tajik_persian_farsi_bidirectional| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|948.4 MB| + +## References + +https://huggingface.co/TurkLangsTeamURFU/pst5-tg-fa-bidirectional \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_pipeline_en.md new file mode 100644 index 00000000000000..f6d187ba0f8c31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-pst5_tajik_persian_farsi_bidirectional_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pst5_tajik_persian_farsi_bidirectional_pipeline pipeline T5Transformer from TurkLangsTeamURFU +author: John Snow Labs +name: pst5_tajik_persian_farsi_bidirectional_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pst5_tajik_persian_farsi_bidirectional_pipeline` is a English model originally trained by TurkLangsTeamURFU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pst5_tajik_persian_farsi_bidirectional_pipeline_en_5.4.2_3.0_1724455209640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pst5_tajik_persian_farsi_bidirectional_pipeline_en_5.4.2_3.0_1724455209640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pst5_tajik_persian_farsi_bidirectional_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pst5_tajik_persian_farsi_bidirectional_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pst5_tajik_persian_farsi_bidirectional_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|948.4 MB| + +## References + +https://huggingface.co/TurkLangsTeamURFU/pst5-tg-fa-bidirectional + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pipeline_pt.md b/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pipeline_pt.md new file mode 100644 index 00000000000000..13eb3f3c1f1524 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pipeline_pt.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Portuguese ptt5_base_portuguese_msmarco_100k_v2_pipeline pipeline T5Transformer from unicamp-dl +author: John Snow Labs +name: ptt5_base_portuguese_msmarco_100k_v2_pipeline +date: 2024-08-23 +tags: [pt, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_portuguese_msmarco_100k_v2_pipeline` is a Portuguese model originally trained by unicamp-dl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v2_pipeline_pt_5.4.2_3.0_1724456916324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v2_pipeline_pt_5.4.2_3.0_1724456916324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_base_portuguese_msmarco_100k_v2_pipeline", lang = "pt") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_base_portuguese_msmarco_100k_v2_pipeline", lang = "pt") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_portuguese_msmarco_100k_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|pt| +|Size:|520.4 MB| + +## References + +https://huggingface.co/unicamp-dl/ptt5-base-pt-msmarco-100k-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pt.md b/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pt.md new file mode 100644 index 00000000000000..5e4a0b7150b957 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ptt5_base_portuguese_msmarco_100k_v2_pt.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Portuguese ptt5_base_portuguese_msmarco_100k_v2 T5Transformer from unicamp-dl +author: John Snow Labs +name: ptt5_base_portuguese_msmarco_100k_v2 +date: 2024-08-23 +tags: [pt, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_portuguese_msmarco_100k_v2` is a Portuguese model originally trained by unicamp-dl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v2_pt_5.4.2_3.0_1724456736686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v2_pt_5.4.2_3.0_1724456736686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_base_portuguese_msmarco_100k_v2","pt") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_base_portuguese_msmarco_100k_v2", "pt") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_portuguese_msmarco_100k_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pt| +|Size:|520.4 MB| + +## References + +https://huggingface.co/unicamp-dl/ptt5-base-pt-msmarco-100k-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_en.md b/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_en.md new file mode 100644 index 00000000000000..ce158e0061dd89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English question2wronganswer T5Transformer from Studyard +author: John Snow Labs +name: question2wronganswer +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question2wronganswer` is a English model originally trained by Studyard. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question2wronganswer_en_5.4.2_3.0_1724407684215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question2wronganswer_en_5.4.2_3.0_1724407684215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("question2wronganswer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("question2wronganswer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question2wronganswer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|983.2 MB| + +## References + +https://huggingface.co/Studyard/Question2WrongAnswer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_pipeline_en.md new file mode 100644 index 00000000000000..e0539d9097e9aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-question2wronganswer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English question2wronganswer_pipeline pipeline T5Transformer from Studyard +author: John Snow Labs +name: question2wronganswer_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question2wronganswer_pipeline` is a English model originally trained by Studyard. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question2wronganswer_pipeline_en_5.4.2_3.0_1724407734995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question2wronganswer_pipeline_en_5.4.2_3.0_1724407734995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("question2wronganswer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("question2wronganswer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question2wronganswer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|983.2 MB| + +## References + +https://huggingface.co/Studyard/Question2WrongAnswer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_en.md b/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_en.md new file mode 100644 index 00000000000000..6c05298ff6284b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English question_generation_auto_t5_v1_base_s T5Transformer from consciousAI +author: John Snow Labs +name: question_generation_auto_t5_v1_base_s +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_generation_auto_t5_v1_base_s` is a English model originally trained by consciousAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_generation_auto_t5_v1_base_s_en_5.4.2_3.0_1724453244027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_generation_auto_t5_v1_base_s_en_5.4.2_3.0_1724453244027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("question_generation_auto_t5_v1_base_s","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("question_generation_auto_t5_v1_base_s", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_generation_auto_t5_v1_base_s| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/consciousAI/question-generation-auto-t5-v1-base-s \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_pipeline_en.md new file mode 100644 index 00000000000000..2b78b0c87e42af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-question_generation_auto_t5_v1_base_s_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English question_generation_auto_t5_v1_base_s_pipeline pipeline T5Transformer from consciousAI +author: John Snow Labs +name: question_generation_auto_t5_v1_base_s_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_generation_auto_t5_v1_base_s_pipeline` is a English model originally trained by consciousAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_generation_auto_t5_v1_base_s_pipeline_en_5.4.2_3.0_1724453293649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_generation_auto_t5_v1_base_s_pipeline_en_5.4.2_3.0_1724453293649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("question_generation_auto_t5_v1_base_s_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("question_generation_auto_t5_v1_base_s_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_generation_auto_t5_v1_base_s_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/consciousAI/question-generation-auto-t5-v1-base-s + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_pipeline_zh.md new file mode 100644 index 00000000000000..f2ba069d164368 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese randeng_t5_784m_multitask_chinese_pipeline pipeline T5Transformer from IDEA-CCNL +author: John Snow Labs +name: randeng_t5_784m_multitask_chinese_pipeline +date: 2024-08-23 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`randeng_t5_784m_multitask_chinese_pipeline` is a Chinese model originally trained by IDEA-CCNL. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/randeng_t5_784m_multitask_chinese_pipeline_zh_5.4.2_3.0_1724422406402.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/randeng_t5_784m_multitask_chinese_pipeline_zh_5.4.2_3.0_1724422406402.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("randeng_t5_784m_multitask_chinese_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("randeng_t5_784m_multitask_chinese_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|randeng_t5_784m_multitask_chinese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|3.1 GB| + +## References + +https://huggingface.co/IDEA-CCNL/Randeng-T5-784M-MultiTask-Chinese + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_zh.md b/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_zh.md new file mode 100644 index 00000000000000..577b1f45f00bb3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-randeng_t5_784m_multitask_chinese_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese randeng_t5_784m_multitask_chinese T5Transformer from IDEA-CCNL +author: John Snow Labs +name: randeng_t5_784m_multitask_chinese +date: 2024-08-23 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`randeng_t5_784m_multitask_chinese` is a Chinese model originally trained by IDEA-CCNL. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/randeng_t5_784m_multitask_chinese_zh_5.4.2_3.0_1724422264617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/randeng_t5_784m_multitask_chinese_zh_5.4.2_3.0_1724422264617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("randeng_t5_784m_multitask_chinese","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("randeng_t5_784m_multitask_chinese", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|randeng_t5_784m_multitask_chinese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|3.1 GB| + +## References + +https://huggingface.co/IDEA-CCNL/Randeng-T5-784M-MultiTask-Chinese \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-real_prompt_300_500sync_all_gen_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-23-real_prompt_300_500sync_all_gen_t5_large_en.md new file mode 100644 index 00000000000000..d0e0ca6359e2f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-real_prompt_300_500sync_all_gen_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_300_500sync_all_gen_t5_large T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_500sync_all_gen_t5_large +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_500sync_all_gen_t5_large` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_500sync_all_gen_t5_large_en_5.4.2_3.0_1724408151235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_500sync_all_gen_t5_large_en_5.4.2_3.0_1724408151235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_300_500sync_all_gen_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_300_500sync_all_gen_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_500sync_all_gen_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-500sync-all-gen-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_en.md b/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_en.md new file mode 100644 index 00000000000000..230d6aa24eed14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rel23_nyt T5Transformer from sominw +author: John Snow Labs +name: rel23_nyt +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rel23_nyt` is a English model originally trained by sominw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rel23_nyt_en_5.4.2_3.0_1724451695591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rel23_nyt_en_5.4.2_3.0_1724451695591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rel23_nyt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rel23_nyt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rel23_nyt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sominw/rel23_nyt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_pipeline_en.md new file mode 100644 index 00000000000000..a31605dc81d324 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rel23_nyt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rel23_nyt_pipeline pipeline T5Transformer from sominw +author: John Snow Labs +name: rel23_nyt_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rel23_nyt_pipeline` is a English model originally trained by sominw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rel23_nyt_pipeline_en_5.4.2_3.0_1724451833261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rel23_nyt_pipeline_en_5.4.2_3.0_1724451833261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rel23_nyt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rel23_nyt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rel23_nyt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sominw/rel23_nyt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_en.md new file mode 100644 index 00000000000000..7f651b5677e035 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rlhf_base_model T5Transformer from JuanKO +author: John Snow Labs +name: rlhf_base_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rlhf_base_model` is a English model originally trained by JuanKO. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rlhf_base_model_en_5.4.2_3.0_1724424942311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rlhf_base_model_en_5.4.2_3.0_1724424942311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rlhf_base_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rlhf_base_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rlhf_base_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanKO/rlhf_base_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_pipeline_en.md new file mode 100644 index 00000000000000..7e51b4dcda82a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rlhf_base_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rlhf_base_model_pipeline pipeline T5Transformer from JuanKO +author: John Snow Labs +name: rlhf_base_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rlhf_base_model_pipeline` is a English model originally trained by JuanKO. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rlhf_base_model_pipeline_en_5.4.2_3.0_1724424992390.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rlhf_base_model_pipeline_en_5.4.2_3.0_1724424992390.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rlhf_base_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rlhf_base_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rlhf_base_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanKO/rlhf_base_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_en.md new file mode 100644 index 00000000000000..862ef4887e5e9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_alanrobotics T5Transformer from AlanRobotics +author: John Snow Labs +name: rut5_base_alanrobotics +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_alanrobotics` is a English model originally trained by AlanRobotics. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_alanrobotics_en_5.4.2_3.0_1724411708761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_alanrobotics_en_5.4.2_3.0_1724411708761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_alanrobotics","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_alanrobotics", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_alanrobotics| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|492.5 MB| + +## References + +https://huggingface.co/AlanRobotics/ruT5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_pipeline_en.md new file mode 100644 index 00000000000000..f175c960cccb0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_alanrobotics_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_alanrobotics_pipeline pipeline T5Transformer from AlanRobotics +author: John Snow Labs +name: rut5_base_alanrobotics_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_alanrobotics_pipeline` is a English model originally trained by AlanRobotics. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_alanrobotics_pipeline_en_5.4.2_3.0_1724411895250.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_alanrobotics_pipeline_en_5.4.2_3.0_1724411895250.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_alanrobotics_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_alanrobotics_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_alanrobotics_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|492.5 MB| + +## References + +https://huggingface.co/AlanRobotics/ruT5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_en.md b/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_en.md new file mode 100644 index 00000000000000..6b3b6866016b9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_finetuned_t5flan T5Transformer from vj1148 +author: John Snow Labs +name: sft_finetuned_t5flan +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_finetuned_t5flan` is a English model originally trained by vj1148. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_finetuned_t5flan_en_5.4.2_3.0_1724439459055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_finetuned_t5flan_en_5.4.2_3.0_1724439459055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_finetuned_t5flan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_finetuned_t5flan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_finetuned_t5flan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/vj1148/sft_finetuned_t5flan \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_pipeline_en.md new file mode 100644 index 00000000000000..1b7a7ca964ce8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-sft_finetuned_t5flan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_finetuned_t5flan_pipeline pipeline T5Transformer from vj1148 +author: John Snow Labs +name: sft_finetuned_t5flan_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_finetuned_t5flan_pipeline` is a English model originally trained by vj1148. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_finetuned_t5flan_pipeline_en_5.4.2_3.0_1724439475884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_finetuned_t5flan_pipeline_en_5.4.2_3.0_1724439475884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_finetuned_t5flan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_finetuned_t5flan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_finetuned_t5flan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/vj1148/sft_finetuned_t5flan + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..b2264a214fde04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724417863354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724417863354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_without_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..67ab8b8dbf663d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724417882181.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724417882181.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_without_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_without_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_en.md new file mode 100644 index 00000000000000..dc72ea52fe6d46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_order_nodes_without_edge_label_sentence_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_without_edge_label_sentence_level_t5_run3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_without_edge_label_sentence_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_en_5.4.2_3.0_1724439084839.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_en_5.4.2_3.0_1724439084839.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_order_nodes_without_edge_label_sentence_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_order_nodes_without_edge_label_sentence_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_without_edge_label_sentence_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.8 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_without_edge_label_sentence_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..b2ffc191b33744 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline_en_5.4.2_3.0_1724439104608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline_en_5.4.2_3.0_1724439104608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_without_edge_label_sentence_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.8 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_without_edge_label_sentence_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_en.md b/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_en.md new file mode 100644 index 00000000000000..9261ee29c69a8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English spell_corrector_mt5_01012024_v2_inbalanced_mistakes T5Transformer from Buseak +author: John Snow Labs +name: spell_corrector_mt5_01012024_v2_inbalanced_mistakes +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spell_corrector_mt5_01012024_v2_inbalanced_mistakes` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spell_corrector_mt5_01012024_v2_inbalanced_mistakes_en_5.4.2_3.0_1724439686983.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spell_corrector_mt5_01012024_v2_inbalanced_mistakes_en_5.4.2_3.0_1724439686983.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spell_corrector_mt5_01012024_v2_inbalanced_mistakes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spell_corrector_mt5_01012024_v2_inbalanced_mistakes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spell_corrector_mt5_01012024_v2_inbalanced_mistakes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/spell_corrector_mt5_01012024_v2_inbalanced_mistakes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline_en.md new file mode 100644 index 00000000000000..ccb1e74c4c3909 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline_en_5.4.2_3.0_1724439839563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline_en_5.4.2_3.0_1724439839563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spell_corrector_mt5_01012024_v2_inbalanced_mistakes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/spell_corrector_mt5_01012024_v2_inbalanced_mistakes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_en.md b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_en.md new file mode 100644 index 00000000000000..17f2ab452192bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_900 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_900 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_900` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_900_en_5.4.2_3.0_1724409821796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_900_en_5.4.2_3.0_1724409821796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_900","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_900", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_900| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-900 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_pipeline_en.md new file mode 100644 index 00000000000000..a87f154cd43d62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_900_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_900_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_900_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_900_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_900_pipeline_en_5.4.2_3.0_1724409868282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_900_pipeline_en_5.4.2_3.0_1724409868282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_900_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_900_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_900_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-900 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_en.md b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_en.md new file mode 100644 index 00000000000000..329d4c5d2fee30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_big T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_en_5.4.2_3.0_1724439480325.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_en_5.4.2_3.0_1724439480325.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_big","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_big", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_pipeline_en.md new file mode 100644 index 00000000000000..c13bc4c22fddfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-speller_t5_big_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_big_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_pipeline_en_5.4.2_3.0_1724439528687.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_pipeline_en_5.4.2_3.0_1724439528687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_big_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_big_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_pipeline_xx.md new file mode 100644 index 00000000000000..303b96d16f0300 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual spelling_correction_multilingual_base_pipeline pipeline T5Transformer from oliverguhr +author: John Snow Labs +name: spelling_correction_multilingual_base_pipeline +date: 2024-08-23 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spelling_correction_multilingual_base_pipeline` is a Multilingual model originally trained by oliverguhr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spelling_correction_multilingual_base_pipeline_xx_5.4.2_3.0_1724423239770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spelling_correction_multilingual_base_pipeline_xx_5.4.2_3.0_1724423239770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spelling_correction_multilingual_base_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spelling_correction_multilingual_base_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spelling_correction_multilingual_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|1.0 GB| + +## References + +https://huggingface.co/oliverguhr/spelling-correction-multilingual-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_xx.md b/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_xx.md new file mode 100644 index 00000000000000..60592c916da5f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-spelling_correction_multilingual_base_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual spelling_correction_multilingual_base T5Transformer from oliverguhr +author: John Snow Labs +name: spelling_correction_multilingual_base +date: 2024-08-23 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spelling_correction_multilingual_base` is a Multilingual model originally trained by oliverguhr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spelling_correction_multilingual_base_xx_5.4.2_3.0_1724423190287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spelling_correction_multilingual_base_xx_5.4.2_3.0_1724423190287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spelling_correction_multilingual_base","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spelling_correction_multilingual_base", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spelling_correction_multilingual_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|1.0 GB| + +## References + +https://huggingface.co/oliverguhr/spelling-correction-multilingual-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_en.md new file mode 100644 index 00000000000000..8af17f71d0b1d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_model_purus15987 T5Transformer from Purus15987 +author: John Snow Labs +name: summarization_model_purus15987 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_model_purus15987` is a English model originally trained by Purus15987. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_model_purus15987_en_5.4.2_3.0_1724413839916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_model_purus15987_en_5.4.2_3.0_1724413839916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_model_purus15987","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_model_purus15987", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_model_purus15987| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.0 MB| + +## References + +https://huggingface.co/Purus15987/Summarization_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_pipeline_en.md new file mode 100644 index 00000000000000..d94bc05c44a94b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_purus15987_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_model_purus15987_pipeline pipeline T5Transformer from Purus15987 +author: John Snow Labs +name: summarization_model_purus15987_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_model_purus15987_pipeline` is a English model originally trained by Purus15987. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_model_purus15987_pipeline_en_5.4.2_3.0_1724413864328.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_model_purus15987_pipeline_en_5.4.2_3.0_1724413864328.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_model_purus15987_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_model_purus15987_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_model_purus15987_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.0 MB| + +## References + +https://huggingface.co/Purus15987/Summarization_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_en.md b/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_en.md new file mode 100644 index 00000000000000..880f2a39ecd7a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t55_flan_t5_base_jssssnnn T5Transformer from tinupicky +author: John Snow Labs +name: t55_flan_t5_base_jssssnnn +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t55_flan_t5_base_jssssnnn` is a English model originally trained by tinupicky. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t55_flan_t5_base_jssssnnn_en_5.4.2_3.0_1724412229212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t55_flan_t5_base_jssssnnn_en_5.4.2_3.0_1724412229212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t55_flan_t5_base_jssssnnn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t55_flan_t5_base_jssssnnn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t55_flan_t5_base_jssssnnn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tinupicky/t55_flan-t5-base-jssssnnn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_pipeline_en.md new file mode 100644 index 00000000000000..259875e861f2e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t55_flan_t5_base_jssssnnn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t55_flan_t5_base_jssssnnn_pipeline pipeline T5Transformer from tinupicky +author: John Snow Labs +name: t55_flan_t5_base_jssssnnn_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t55_flan_t5_base_jssssnnn_pipeline` is a English model originally trained by tinupicky. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t55_flan_t5_base_jssssnnn_pipeline_en_5.4.2_3.0_1724412276401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t55_flan_t5_base_jssssnnn_pipeline_en_5.4.2_3.0_1724412276401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t55_flan_t5_base_jssssnnn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t55_flan_t5_base_jssssnnn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t55_flan_t5_base_jssssnnn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tinupicky/t55_flan-t5-base-jssssnnn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_en.md new file mode 100644 index 00000000000000..f12b9f38897ac1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1_1_lm100k_large_1632 T5Transformer from bangnbx +author: John Snow Labs +name: t5_1_1_lm100k_large_1632 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_large_1632` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_1632_en_5.4.2_3.0_1724436610914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_1632_en_5.4.2_3.0_1724436610914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1_1_lm100k_large_1632","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1_1_lm100k_large_1632", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_large_1632| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/bangnbx/t5.1.1.lm100k.large-1632 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_pipeline_en.md new file mode 100644 index 00000000000000..fa706d6f393f3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_1_1_lm100k_large_1632_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1_1_lm100k_large_1632_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_1_1_lm100k_large_1632_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_large_1632_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_1632_pipeline_en_5.4.2_3.0_1724436804778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_1632_pipeline_en_5.4.2_3.0_1724436804778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1_1_lm100k_large_1632_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1_1_lm100k_large_1632_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_large_1632_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/bangnbx/t5.1.1.lm100k.large-1632 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_en.md new file mode 100644 index 00000000000000..086e896d965e00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_3epochs T5Transformer from Kau-stuv +author: John Snow Labs +name: t5_3epochs +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3epochs` is a English model originally trained by Kau-stuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3epochs_en_5.4.2_3.0_1724436872109.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3epochs_en_5.4.2_3.0_1724436872109.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_3epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_3epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|983.3 MB| + +## References + +https://huggingface.co/Kau-stuv/t5-3epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_pipeline_en.md new file mode 100644 index 00000000000000..f00e2afda97abf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_3epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_3epochs_pipeline pipeline T5Transformer from Kau-stuv +author: John Snow Labs +name: t5_3epochs_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3epochs_pipeline` is a English model originally trained by Kau-stuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3epochs_pipeline_en_5.4.2_3.0_1724436922692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3epochs_pipeline_en_5.4.2_3.0_1724436922692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_3epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_3epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|983.3 MB| + +## References + +https://huggingface.co/Kau-stuv/t5-3epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_en.md new file mode 100644 index 00000000000000..59b009471d8fbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_aic_2012_2014 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_2012_2014 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_2012_2014` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2012_2014_en_5.4.2_3.0_1724449621925.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2012_2014_en_5.4.2_3.0_1724449621925.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_aic_2012_2014","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_aic_2012_2014", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_2012_2014| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|310.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-2012-2014 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_pipeline_en.md new file mode 100644 index 00000000000000..a59d79fc8faa05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_2012_2014_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_aic_2012_2014_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_2012_2014_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_2012_2014_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2012_2014_pipeline_en_5.4.2_3.0_1724449647185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2012_2014_pipeline_en_5.4.2_3.0_1724449647185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_aic_2012_2014_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_aic_2012_2014_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_2012_2014_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|310.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-2012-2014 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_en.md new file mode 100644 index 00000000000000..8b144276a0685f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2018_2020 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2018_2020 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2018_2020` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2018_2020_en_5.4.2_3.0_1724435428702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2018_2020_en_5.4.2_3.0_1724435428702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2018_2020","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2018_2020", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2018_2020| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2018-2020 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_pipeline_en.md new file mode 100644 index 00000000000000..15e595fb10dc55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_arxiv_2018_2020_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2018_2020_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2018_2020_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2018_2020_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2018_2020_pipeline_en_5.4.2_3.0_1724435449003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2018_2020_pipeline_en_5.4.2_3.0_1724435449003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_arxiv_2018_2020_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_arxiv_2018_2020_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2018_2020_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2018-2020 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_en.md new file mode 100644 index 00000000000000..09cb431fa90d92 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_4_en_5.4.2_3.0_1724455002788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_4_en_5.4.2_3.0_1724455002788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_pipeline_en.md new file mode 100644 index 00000000000000..e4b5208e2cf57a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_4_pipeline_en_5.4.2_3.0_1724455019249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_4_pipeline_en_5.4.2_3.0_1724455019249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_en.md new file mode 100644 index 00000000000000..8763f13f81760a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_9 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_9_en_5.4.2_3.0_1724452203525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_9_en_5.4.2_3.0_1724452203525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_pipeline_en.md new file mode 100644 index 00000000000000..8ca1dc0fd99888 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_9_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_9_pipeline_en_5.4.2_3.0_1724452220324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_9_pipeline_en_5.4.2_3.0_1724452220324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_en.md new file mode 100644 index 00000000000000..6b123cd137f5b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_6 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_6_en_5.4.2_3.0_1724452899548.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_6_en_5.4.2_3.0_1724452899548.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_pipeline_en.md new file mode 100644 index 00000000000000..51ba01f231c089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_6_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_6_pipeline_en_5.4.2_3.0_1724452917083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_6_pipeline_en_5.4.2_3.0_1724452917083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_en.md new file mode 100644 index 00000000000000..ae62f8e8bde3f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_3_en_5.4.2_3.0_1724412587064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_3_en_5.4.2_3.0_1724412587064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_pipeline_en.md new file mode 100644 index 00000000000000..6fd727dea518e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_3_pipeline_en_5.4.2_3.0_1724412615126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_3_pipeline_en_5.4.2_3.0_1724412615126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_en.md new file mode 100644 index 00000000000000..5c5e89395ecb70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_5 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_5` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_5_en_5.4.2_3.0_1724417653212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_5_en_5.4.2_3.0_1724417653212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_pipeline_en.md new file mode 100644 index 00000000000000..6d83444e3bcd79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2019_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_5_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_5_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_5_pipeline_en_5.4.2_3.0_1724417682326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_5_pipeline_en_5.4.2_3.0_1724417682326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_en.md new file mode 100644 index 00000000000000..35565d23784ea0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_6 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_6_en_5.4.2_3.0_1724441484606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_6_en_5.4.2_3.0_1724441484606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_pipeline_en.md new file mode 100644 index 00000000000000..e888c59b87fae7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_6_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_6_pipeline_en_5.4.2_3.0_1724441513267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_6_pipeline_en_5.4.2_3.0_1724441513267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2020_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2020_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_en.md new file mode 100644 index 00000000000000..52b30c259dc898 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_7m_large T5Transformer from versae +author: John Snow Labs +name: t5_7m_large +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_7m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_7m_large_en_5.4.2_3.0_1724448289274.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_7m_large_en_5.4.2_3.0_1724448289274.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_7m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_7m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_7m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-7m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_pipeline_en.md new file mode 100644 index 00000000000000..fd186ebc23714d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_7m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_7m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_7m_large_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_7m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_7m_large_pipeline_en_5.4.2_3.0_1724448423537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_7m_large_pipeline_en_5.4.2_3.0_1724448423537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_7m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_7m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_7m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-7m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_en.md new file mode 100644 index 00000000000000..6c13d05855fb4a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_english_tonga_tonga_islands_hindi T5Transformer from Venkatesh4342 +author: John Snow Labs +name: t5_base_english_tonga_tonga_islands_hindi +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_english_tonga_tonga_islands_hindi` is a English model originally trained by Venkatesh4342. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_english_tonga_tonga_islands_hindi_en_5.4.2_3.0_1724456015171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_english_tonga_tonga_islands_hindi_en_5.4.2_3.0_1724456015171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_english_tonga_tonga_islands_hindi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_english_tonga_tonga_islands_hindi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_english_tonga_tonga_islands_hindi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Venkatesh4342/t5-base-en-to-hi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_pipeline_en.md new file mode 100644 index 00000000000000..07afe44b2bbc24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_english_tonga_tonga_islands_hindi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_english_tonga_tonga_islands_hindi_pipeline pipeline T5Transformer from Venkatesh4342 +author: John Snow Labs +name: t5_base_english_tonga_tonga_islands_hindi_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_english_tonga_tonga_islands_hindi_pipeline` is a English model originally trained by Venkatesh4342. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_english_tonga_tonga_islands_hindi_pipeline_en_5.4.2_3.0_1724456066905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_english_tonga_tonga_islands_hindi_pipeline_en_5.4.2_3.0_1724456066905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_english_tonga_tonga_islands_hindi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_english_tonga_tonga_islands_hindi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_english_tonga_tonga_islands_hindi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Venkatesh4342/t5-base-en-to-hi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..c57a2e4705905f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724443979088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724443979088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|954.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..dcd4654b3674fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724444041969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724444041969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|954.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..cd49f59672688a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724409474696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724409474696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|934.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-32-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..03d77d2b71a00d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724409544820.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724409544820.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_32_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|934.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-32-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_en.md new file mode 100644 index 00000000000000..180670bc1c46f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_e2m_intent T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_e2m_intent +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_e2m_intent` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_e2m_intent_en_5.4.2_3.0_1724425300642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_e2m_intent_en_5.4.2_3.0_1724425300642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_e2m_intent","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_e2m_intent", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_e2m_intent| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|921.2 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-e2m-intent \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_pipeline_en.md new file mode 100644 index 00000000000000..37d8cd221c860f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_e2m_intent_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_e2m_intent_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_e2m_intent_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_e2m_intent_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_e2m_intent_pipeline_en_5.4.2_3.0_1724425373503.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_e2m_intent_pipeline_en_5.4.2_3.0_1724425373503.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_e2m_intent_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_e2m_intent_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_e2m_intent_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|921.2 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-e2m-intent + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_en.md new file mode 100644 index 00000000000000..8207803dc4ab71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz T5Transformer from AnabFaiaz +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz` is a English model originally trained by AnabFaiaz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_en_5.4.2_3.0_1724408539671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_en_5.4.2_3.0_1724408539671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|951.4 MB| + +## References + +https://huggingface.co/AnabFaiaz/t5-base-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline_en.md new file mode 100644 index 00000000000000..f9bbe628e83e1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline pipeline T5Transformer from AnabFaiaz +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline` is a English model originally trained by AnabFaiaz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline_en_5.4.2_3.0_1724408593907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline_en_5.4.2_3.0_1724408593907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_anabfaiaz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|951.4 MB| + +## References + +https://huggingface.co/AnabFaiaz/t5-base-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_en.md new file mode 100644 index 00000000000000..db3cf68e3023f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou T5Transformer from j0hngou +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_en_5.4.2_3.0_1724409648166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_en_5.4.2_3.0_1724409648166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/j0hngou/t5-base-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline_en.md new file mode 100644 index 00000000000000..3e987ac78c2c90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline pipeline T5Transformer from j0hngou +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline_en_5.4.2_3.0_1724409694727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline_en_5.4.2_3.0_1724409694727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_j0hngou_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/j0hngou/t5-base-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_en.md new file mode 100644 index 00000000000000..973fcf0dfb5bc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_imdb_sentiment T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_imdb_sentiment +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_imdb_sentiment` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_imdb_sentiment_en_5.4.2_3.0_1724424745132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_imdb_sentiment_en_5.4.2_3.0_1724424745132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_imdb_sentiment","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_imdb_sentiment", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_imdb_sentiment| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|962.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-imdb-sentiment \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_pipeline_en.md new file mode 100644 index 00000000000000..3dd5d87ea77cd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_imdb_sentiment_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_imdb_sentiment_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_imdb_sentiment_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_imdb_sentiment_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_imdb_sentiment_pipeline_en_5.4.2_3.0_1724424807393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_imdb_sentiment_pipeline_en_5.4.2_3.0_1724424807393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_imdb_sentiment_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_imdb_sentiment_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_imdb_sentiment_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|962.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-imdb-sentiment + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_en.md new file mode 100644 index 00000000000000..fdb3326c1ca66c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_question_tonga_tonga_islands_answer T5Transformer from RohanHBTU +author: John Snow Labs +name: t5_base_finetuned_question_tonga_tonga_islands_answer +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_question_tonga_tonga_islands_answer` is a English model originally trained by RohanHBTU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_question_tonga_tonga_islands_answer_en_5.4.2_3.0_1724431389659.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_question_tonga_tonga_islands_answer_en_5.4.2_3.0_1724431389659.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_question_tonga_tonga_islands_answer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_question_tonga_tonga_islands_answer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_question_tonga_tonga_islands_answer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RohanHBTU/t5-base-finetuned-question-to-answer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md new file mode 100644 index 00000000000000..329d09aa8729c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline pipeline T5Transformer from RohanHBTU +author: John Snow Labs +name: t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline` is a English model originally trained by RohanHBTU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline_en_5.4.2_3.0_1724431457856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline_en_5.4.2_3.0_1724431457856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_question_tonga_tonga_islands_answer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RohanHBTU/t5-base-finetuned-question-to-answer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_en.md new file mode 100644 index 00000000000000..5b1e8498918a72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_kbh T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_kbh +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_kbh` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kbh_en_5.4.2_3.0_1724418113789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kbh_en_5.4.2_3.0_1724418113789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_kbh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_kbh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_kbh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|956.1 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-kbh \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline_en.md new file mode 100644 index 00000000000000..c0fb6d4f9be2e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline pipeline T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline_en_5.4.2_3.0_1724418165131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline_en_5.4.2_3.0_1724418165131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_kbh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|956.1 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-kbh + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_en.md new file mode 100644 index 00000000000000..6a9f5424874ed5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_summarize_news_tuto_noticias T5Transformer from EP9 +author: John Snow Labs +name: t5_base_finetuned_summarize_news_tuto_noticias +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_summarize_news_tuto_noticias` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_summarize_news_tuto_noticias_en_5.4.2_3.0_1724448196773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_summarize_news_tuto_noticias_en_5.4.2_3.0_1724448196773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_summarize_news_tuto_noticias","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_summarize_news_tuto_noticias", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_summarize_news_tuto_noticias| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/EP9/t5-base-finetuned-summarize-news-tuto-noticias \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_pipeline_en.md new file mode 100644 index 00000000000000..a174fc2dfb6508 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_summarize_news_tuto_noticias_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_summarize_news_tuto_noticias_pipeline pipeline T5Transformer from EP9 +author: John Snow Labs +name: t5_base_finetuned_summarize_news_tuto_noticias_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_summarize_news_tuto_noticias_pipeline` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_summarize_news_tuto_noticias_pipeline_en_5.4.2_3.0_1724448243508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_summarize_news_tuto_noticias_pipeline_en_5.4.2_3.0_1724448243508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_summarize_news_tuto_noticias_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_summarize_news_tuto_noticias_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_summarize_news_tuto_noticias_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/EP9/t5-base-finetuned-summarize-news-tuto-noticias + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_en.md new file mode 100644 index 00000000000000..b4521843f587f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_grammar_correction_vennify T5Transformer from vennify +author: John Snow Labs +name: t5_base_grammar_correction_vennify +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_grammar_correction_vennify` is a English model originally trained by vennify. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_grammar_correction_vennify_en_5.4.2_3.0_1724419950723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_grammar_correction_vennify_en_5.4.2_3.0_1724419950723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_grammar_correction_vennify","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_grammar_correction_vennify", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_grammar_correction_vennify| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.3 MB| + +## References + +https://huggingface.co/vennify/t5-base-grammar-correction \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_pipeline_en.md new file mode 100644 index 00000000000000..d23120560fb361 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_grammar_correction_vennify_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_grammar_correction_vennify_pipeline pipeline T5Transformer from vennify +author: John Snow Labs +name: t5_base_grammar_correction_vennify_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_grammar_correction_vennify_pipeline` is a English model originally trained by vennify. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_grammar_correction_vennify_pipeline_en_5.4.2_3.0_1724420007477.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_grammar_correction_vennify_pipeline_en_5.4.2_3.0_1724420007477.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_grammar_correction_vennify_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_grammar_correction_vennify_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_grammar_correction_vennify_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.3 MB| + +## References + +https://huggingface.co/vennify/t5-base-grammar-correction + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_en.md new file mode 100644 index 00000000000000..8690514ca86467 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_kw2email_v4 T5Transformer from postbot +author: John Snow Labs +name: t5_base_kw2email_v4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_kw2email_v4` is a English model originally trained by postbot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_kw2email_v4_en_5.4.2_3.0_1724442872307.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_kw2email_v4_en_5.4.2_3.0_1724442872307.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_kw2email_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_kw2email_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_kw2email_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/postbot/t5-base-kw2email-v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_pipeline_en.md new file mode 100644 index 00000000000000..eb7904f32f2b5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_kw2email_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_kw2email_v4_pipeline pipeline T5Transformer from postbot +author: John Snow Labs +name: t5_base_kw2email_v4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_kw2email_v4_pipeline` is a English model originally trained by postbot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_kw2email_v4_pipeline_en_5.4.2_3.0_1724442922205.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_kw2email_v4_pipeline_en_5.4.2_3.0_1724442922205.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_kw2email_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_kw2email_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_kw2email_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/postbot/t5-base-kw2email-v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_en.md new file mode 100644 index 00000000000000..8af5ec0933410f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_lindsaytest_bias T5Transformer from lindsayng +author: John Snow Labs +name: t5_base_lindsaytest_bias +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lindsaytest_bias` is a English model originally trained by lindsayng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lindsaytest_bias_en_5.4.2_3.0_1724410728202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lindsaytest_bias_en_5.4.2_3.0_1724410728202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_lindsaytest_bias","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_lindsaytest_bias", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lindsaytest_bias| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|982.9 MB| + +## References + +https://huggingface.co/lindsayng/t5-base-lindsaytest-bias \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_pipeline_en.md new file mode 100644 index 00000000000000..d0e7b6bf4439ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lindsaytest_bias_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_lindsaytest_bias_pipeline pipeline T5Transformer from lindsayng +author: John Snow Labs +name: t5_base_lindsaytest_bias_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lindsaytest_bias_pipeline` is a English model originally trained by lindsayng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lindsaytest_bias_pipeline_en_5.4.2_3.0_1724410784032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lindsaytest_bias_pipeline_en_5.4.2_3.0_1724410784032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_lindsaytest_bias_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_lindsaytest_bias_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lindsaytest_bias_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|982.9 MB| + +## References + +https://huggingface.co/lindsayng/t5-base-lindsaytest-bias + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_en.md new file mode 100644 index 00000000000000..848ec201fd069a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_lora_only_combined_e10_256 T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_only_combined_e10_256 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_only_combined_e10_256` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_only_combined_e10_256_en_5.4.2_3.0_1724450043392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_only_combined_e10_256_en_5.4.2_3.0_1724450043392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_lora_only_combined_e10_256","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_lora_only_combined_e10_256", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_only_combined_e10_256| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.0 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-only-combined-e10-256 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_pipeline_en.md new file mode 100644 index 00000000000000..39fdea84538ecd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_lora_only_combined_e10_256_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_lora_only_combined_e10_256_pipeline pipeline T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_only_combined_e10_256_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_only_combined_e10_256_pipeline` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_only_combined_e10_256_pipeline_en_5.4.2_3.0_1724450126626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_only_combined_e10_256_pipeline_en_5.4.2_3.0_1724450126626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_lora_only_combined_e10_256_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_lora_only_combined_e10_256_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_only_combined_e10_256_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.0 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-only-combined-e10-256 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_en.md new file mode 100644 index 00000000000000..4631135c3666cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_make_natural_2 T5Transformer from jaekwanyda +author: John Snow Labs +name: t5_base_make_natural_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_make_natural_2` is a English model originally trained by jaekwanyda. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_2_en_5.4.2_3.0_1724436661583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_2_en_5.4.2_3.0_1724436661583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_make_natural_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_make_natural_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_make_natural_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaekwanyda/T5_base_make_natural_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_pipeline_en.md new file mode 100644 index 00000000000000..3093e8eaa7ceb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_make_natural_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_make_natural_2_pipeline pipeline T5Transformer from jaekwanyda +author: John Snow Labs +name: t5_base_make_natural_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_make_natural_2_pipeline` is a English model originally trained by jaekwanyda. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_2_pipeline_en_5.4.2_3.0_1724436731740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_2_pipeline_en_5.4.2_3.0_1724436731740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_make_natural_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_make_natural_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_make_natural_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaekwanyda/T5_base_make_natural_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_en.md new file mode 100644 index 00000000000000..344ccb3e0ecf46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_mediasum_reverse_train T5Transformer from PSW +author: John Snow Labs +name: t5_base_mediasum_reverse_train +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mediasum_reverse_train` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mediasum_reverse_train_en_5.4.2_3.0_1724437701621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mediasum_reverse_train_en_5.4.2_3.0_1724437701621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_mediasum_reverse_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_mediasum_reverse_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mediasum_reverse_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-mediasum-reverse-train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_pipeline_en.md new file mode 100644 index 00000000000000..148f43f319c896 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mediasum_reverse_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_mediasum_reverse_train_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_mediasum_reverse_train_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mediasum_reverse_train_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mediasum_reverse_train_pipeline_en_5.4.2_3.0_1724437760836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mediasum_reverse_train_pipeline_en_5.4.2_3.0_1724437760836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_mediasum_reverse_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_mediasum_reverse_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mediasum_reverse_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-mediasum-reverse-train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_pipeline_xx.md new file mode 100644 index 00000000000000..2afedc1848a90e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual t5_base_ncc_modern_pipeline pipeline T5Transformer from north +author: John Snow Labs +name: t5_base_ncc_modern_pipeline +date: 2024-08-23 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_modern_pipeline` is a Multilingual model originally trained by north. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_modern_pipeline_xx_5.4.2_3.0_1724427493927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_modern_pipeline_xx_5.4.2_3.0_1724427493927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ncc_modern_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ncc_modern_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_modern_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|2.9 GB| + +## References + +https://huggingface.co/north/t5_base_NCC_modern + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_xx.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_xx.md new file mode 100644 index 00000000000000..2b6c4456c1d19d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_ncc_modern_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual t5_base_ncc_modern T5Transformer from north +author: John Snow Labs +name: t5_base_ncc_modern +date: 2024-08-23 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_modern` is a Multilingual model originally trained by north. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_modern_xx_5.4.2_3.0_1724427349962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_modern_xx_5.4.2_3.0_1724427349962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ncc_modern","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ncc_modern", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_modern| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|2.9 GB| + +## References + +https://huggingface.co/north/t5_base_NCC_modern \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_en.md new file mode 100644 index 00000000000000..200afa023979bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_4rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_4rear +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_4rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_4rear_en_5.4.2_3.0_1724434827222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_4rear_en_5.4.2_3.0_1724434827222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_4rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_4rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_4rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-4rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_pipeline_en.md new file mode 100644 index 00000000000000..c01da06b28d642 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_4rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_4rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_4rear_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_4rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_4rear_pipeline_en_5.4.2_3.0_1724434878518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_4rear_pipeline_en_5.4.2_3.0_1724434878518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_4rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_4rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_4rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-4rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_en.md new file mode 100644 index 00000000000000..5192c168140816 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_5rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_5rear +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_5rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_5rear_en_5.4.2_3.0_1724431389991.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_5rear_en_5.4.2_3.0_1724431389991.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_5rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_5rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_5rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-5rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_pipeline_en.md new file mode 100644 index 00000000000000..4cb7216764f5b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_5rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_5rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_5rear_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_5rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_5rear_pipeline_en_5.4.2_3.0_1724431457655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_5rear_pipeline_en_5.4.2_3.0_1724431457655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_5rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_5rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_5rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-5rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_en.md new file mode 100644 index 00000000000000..ef34b22ec21cdb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_2front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_2front_1body_0rear +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_2front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_2front_1body_0rear_en_5.4.2_3.0_1724445044076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_2front_1body_0rear_en_5.4.2_3.0_1724445044076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_2front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_2front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_2front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-2front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..a4b5ec5c6afa2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_2front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_2front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_2front_1body_0rear_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_2front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_2front_1body_0rear_pipeline_en_5.4.2_3.0_1724445096433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_2front_1body_0rear_pipeline_en_5.4.2_3.0_1724445096433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_2front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_2front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_2front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-2front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_en.md new file mode 100644 index 00000000000000..f630f96b3d34fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_translation_guyhadad01 T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_base_translation_guyhadad01 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_translation_guyhadad01` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_translation_guyhadad01_en_5.4.2_3.0_1724446198700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_translation_guyhadad01_en_5.4.2_3.0_1724446198700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_translation_guyhadad01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_translation_guyhadad01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_translation_guyhadad01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/guyhadad01/t5-base-translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_pipeline_en.md new file mode 100644 index 00000000000000..6b482d097d600c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_translation_guyhadad01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_translation_guyhadad01_pipeline pipeline T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_base_translation_guyhadad01_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_translation_guyhadad01_pipeline` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_translation_guyhadad01_pipeline_en_5.4.2_3.0_1724446245647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_translation_guyhadad01_pipeline_en_5.4.2_3.0_1724446245647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_translation_guyhadad01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_translation_guyhadad01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_translation_guyhadad01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/guyhadad01/t5-base-translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_en.md new file mode 100644 index 00000000000000..faa1f72339a233 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_base_nl24 T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_nl24 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_nl24` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl24_en_5.4.2_3.0_1724428052326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl24_en_5.4.2_3.0_1724428052326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_base_nl24","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_base_nl24", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_nl24| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|902.4 MB| + +## References + +https://huggingface.co/google/t5-efficient-base-nl24 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_pipeline_en.md new file mode 100644 index 00000000000000..2118511ad0a03b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_base_nl24_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_base_nl24_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_nl24_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_nl24_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl24_pipeline_en_5.4.2_3.0_1724428350134.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl24_pipeline_en_5.4.2_3.0_1724428350134.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_base_nl24_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_base_nl24_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_nl24_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|902.5 MB| + +## References + +https://huggingface.co/google/t5-efficient-base-nl24 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_de.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_de.md new file mode 100644 index 00000000000000..9c50cb34195e7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German t5_efficient_gc4_german_base_nl36 T5Transformer from GermanT5 +author: John Snow Labs +name: t5_efficient_gc4_german_base_nl36 +date: 2024-08-23 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_gc4_german_base_nl36` is a German model originally trained by GermanT5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_gc4_german_base_nl36_de_5.4.2_3.0_1724425822023.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_gc4_german_base_nl36_de_5.4.2_3.0_1724425822023.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_gc4_german_base_nl36","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_gc4_german_base_nl36", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_gc4_german_base_nl36| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.3 GB| + +## References + +https://huggingface.co/GermanT5/t5-efficient-gc4-german-base-nl36 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_pipeline_de.md new file mode 100644 index 00000000000000..3ceffd967d9050 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_gc4_german_base_nl36_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German t5_efficient_gc4_german_base_nl36_pipeline pipeline T5Transformer from GermanT5 +author: John Snow Labs +name: t5_efficient_gc4_german_base_nl36_pipeline +date: 2024-08-23 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_gc4_german_base_nl36_pipeline` is a German model originally trained by GermanT5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_gc4_german_base_nl36_pipeline_de_5.4.2_3.0_1724426239245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_gc4_german_base_nl36_pipeline_de_5.4.2_3.0_1724426239245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_gc4_german_base_nl36_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_gc4_german_base_nl36_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_gc4_german_base_nl36_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.3 GB| + +## References + +https://huggingface.co/GermanT5/t5-efficient-gc4-german-base-nl36 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_en.md new file mode 100644 index 00000000000000..1554ad836f41e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_en.md @@ -0,0 +1,94 @@ +--- +layout: model +title: English T5ForConditionalGeneration Large Cased model (from google) +author: John Snow Labs +name: t5_efficient_large_dm256 +date: 2024-08-23 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-efficient-large-dm256` is a English model originally trained by `google`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dm256_en_5.4.2_3.0_1724421799513.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dm256_en_5.4.2_3.0_1724421799513.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_efficient_large_dm256","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_dm256","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_dm256| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|385.2 MB| + +## References + +References + +- https://huggingface.co/google/t5-efficient-large-dm256 +- https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html +- https://arxiv.org/abs/2109.10686 +- https://arxiv.org/abs/2109.10686 +- https://github.com/google-research/google-research/issues/986#issuecomment-1035051145 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_pipeline_en.md new file mode 100644 index 00000000000000..07f41a24c036b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_efficient_large_dm256_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_large_dm256_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_dm256_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_dm256_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dm256_pipeline_en_5.4.2_3.0_1724421929158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dm256_pipeline_en_5.4.2_3.0_1724421929158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_large_dm256_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_large_dm256_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_dm256_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|385.2 MB| + +## References + +https://huggingface.co/google/t5-efficient-large-dm256 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_en.md new file mode 100644 index 00000000000000..6d12fffe3b8c99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_end2end_questions_generation_squadv2 T5Transformer from wiselinjayajos +author: John Snow Labs +name: t5_end2end_questions_generation_squadv2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_end2end_questions_generation_squadv2` is a English model originally trained by wiselinjayajos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_squadv2_en_5.4.2_3.0_1724416274651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_squadv2_en_5.4.2_3.0_1724416274651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_end2end_questions_generation_squadv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_end2end_questions_generation_squadv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_end2end_questions_generation_squadv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|877.7 MB| + +## References + +https://huggingface.co/wiselinjayajos/t5-end2end-questions-generation-squadV2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_pipeline_en.md new file mode 100644 index 00000000000000..eb75a41761436d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_end2end_questions_generation_squadv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_end2end_questions_generation_squadv2_pipeline pipeline T5Transformer from wiselinjayajos +author: John Snow Labs +name: t5_end2end_questions_generation_squadv2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_end2end_questions_generation_squadv2_pipeline` is a English model originally trained by wiselinjayajos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_squadv2_pipeline_en_5.4.2_3.0_1724416355489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_squadv2_pipeline_en_5.4.2_3.0_1724416355489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_end2end_questions_generation_squadv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_end2end_questions_generation_squadv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_end2end_questions_generation_squadv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|877.7 MB| + +## References + +https://huggingface.co/wiselinjayajos/t5-end2end-questions-generation-squadV2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_en.md new file mode 100644 index 00000000000000..afa1cec2ee320b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_en.md @@ -0,0 +1,91 @@ +--- +layout: model +title: English T5ForConditionalGeneration Cased model (from cometrain) +author: John Snow Labs +name: t5_fake_news_detector +date: 2024-08-23 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `fake-news-detector-t5` is a English model originally trained by `cometrain`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fake_news_detector_en_5.4.2_3.0_1724419202406.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fake_news_detector_en_5.4.2_3.0_1724419202406.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_fake_news_detector","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fake_news_detector","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fake_news_detector| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.2 MB| + +## References + +References + +- https://huggingface.co/cometrain/fake-news-detector-t5 +- https://www.kaggle.com/datasets/clmentbisaillon/fake-and-real-news-dataset \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_pipeline_en.md new file mode 100644 index 00000000000000..5951c4269a1182 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_fake_news_detector_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fake_news_detector_pipeline pipeline T5Transformer from cometrain +author: John Snow Labs +name: t5_fake_news_detector_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fake_news_detector_pipeline` is a English model originally trained by cometrain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fake_news_detector_pipeline_en_5.4.2_3.0_1724419223978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fake_news_detector_pipeline_en_5.4.2_3.0_1724419223978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fake_news_detector_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fake_news_detector_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fake_news_detector_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.2 MB| + +## References + +https://huggingface.co/cometrain/fake-news-detector-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_en.md new file mode 100644 index 00000000000000..7f1d6cfbca0729 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fine_tunning_nlp_test T5Transformer from DVillada +author: John Snow Labs +name: t5_fine_tunning_nlp_test +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tunning_nlp_test` is a English model originally trained by DVillada. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tunning_nlp_test_en_5.4.2_3.0_1724417857576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tunning_nlp_test_en_5.4.2_3.0_1724417857576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fine_tunning_nlp_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fine_tunning_nlp_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tunning_nlp_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|947.3 MB| + +## References + +https://huggingface.co/DVillada/T5_fine_tunning_NLP_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_pipeline_en.md new file mode 100644 index 00000000000000..5a9dd3e6b272b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_fine_tunning_nlp_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fine_tunning_nlp_test_pipeline pipeline T5Transformer from DVillada +author: John Snow Labs +name: t5_fine_tunning_nlp_test_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tunning_nlp_test_pipeline` is a English model originally trained by DVillada. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tunning_nlp_test_pipeline_en_5.4.2_3.0_1724417919848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tunning_nlp_test_pipeline_en_5.4.2_3.0_1724417919848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fine_tunning_nlp_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fine_tunning_nlp_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tunning_nlp_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|947.3 MB| + +## References + +https://huggingface.co/DVillada/T5_fine_tunning_NLP_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_en.md new file mode 100644 index 00000000000000..682485f165fe20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_english_tonga_tonga_islands_spanish_eval1 T5Transformer from tsetsuuhei +author: John Snow Labs +name: t5_finetuned_english_tonga_tonga_islands_spanish_eval1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_english_tonga_tonga_islands_spanish_eval1` is a English model originally trained by tsetsuuhei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_english_tonga_tonga_islands_spanish_eval1_en_5.4.2_3.0_1724454709185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_english_tonga_tonga_islands_spanish_eval1_en_5.4.2_3.0_1724454709185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_english_tonga_tonga_islands_spanish_eval1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_english_tonga_tonga_islands_spanish_eval1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_english_tonga_tonga_islands_spanish_eval1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tsetsuuhei/t5-finetuned-en-to-es-eval1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline_en.md new file mode 100644 index 00000000000000..ac21572a63962f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline pipeline T5Transformer from tsetsuuhei +author: John Snow Labs +name: t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline` is a English model originally trained by tsetsuuhei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline_en_5.4.2_3.0_1724454757720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline_en_5.4.2_3.0_1724454757720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_english_tonga_tonga_islands_spanish_eval1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tsetsuuhei/t5-finetuned-en-to-es-eval1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_en.md new file mode 100644 index 00000000000000..69df5fd4f23fc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_storycommonsense_noprompt T5Transformer from Yuetian +author: John Snow Labs +name: t5_finetuned_storycommonsense_noprompt +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_storycommonsense_noprompt` is a English model originally trained by Yuetian. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_storycommonsense_noprompt_en_5.4.2_3.0_1724418435347.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_storycommonsense_noprompt_en_5.4.2_3.0_1724418435347.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_storycommonsense_noprompt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_storycommonsense_noprompt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_storycommonsense_noprompt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Yuetian/T5-finetuned-storyCommonsense-noPrompt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_pipeline_en.md new file mode 100644 index 00000000000000..d6c2779fd598c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_finetuned_storycommonsense_noprompt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_storycommonsense_noprompt_pipeline pipeline T5Transformer from Yuetian +author: John Snow Labs +name: t5_finetuned_storycommonsense_noprompt_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_storycommonsense_noprompt_pipeline` is a English model originally trained by Yuetian. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_storycommonsense_noprompt_pipeline_en_5.4.2_3.0_1724418482288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_storycommonsense_noprompt_pipeline_en_5.4.2_3.0_1724418482288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_storycommonsense_noprompt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_storycommonsense_noprompt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_storycommonsense_noprompt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Yuetian/T5-finetuned-storyCommonsense-noPrompt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_pipeline_tw.md b/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_pipeline_tw.md new file mode 100644 index 00000000000000..9e49c722a90f81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_pipeline_tw.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Twi t5_hotel_review_sentiment_pipeline pipeline T5Transformer from clhuang +author: John Snow Labs +name: t5_hotel_review_sentiment_pipeline +date: 2024-08-23 +tags: [tw, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: tw +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_hotel_review_sentiment_pipeline` is a Twi model originally trained by clhuang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hotel_review_sentiment_pipeline_tw_5.4.2_3.0_1724419404033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hotel_review_sentiment_pipeline_tw_5.4.2_3.0_1724419404033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_hotel_review_sentiment_pipeline", lang = "tw") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_hotel_review_sentiment_pipeline", lang = "tw") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hotel_review_sentiment_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|tw| +|Size:|1.0 GB| + +## References + +https://huggingface.co/clhuang/t5-hotel-review-sentiment + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_tw.md b/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_tw.md new file mode 100644 index 00000000000000..448894d944e0ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_hotel_review_sentiment_tw.md @@ -0,0 +1,90 @@ +--- +layout: model +title: Twi T5ForConditionalGeneration Cased model (from clhuang) +author: John Snow Labs +name: t5_hotel_review_sentiment +date: 2024-08-23 +tags: [tw, open_source, t5, onnx] +task: Text Generation +language: tw +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-hotel-review-sentiment` is a Twi model originally trained by `clhuang`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hotel_review_sentiment_tw_5.4.2_3.0_1724419358561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hotel_review_sentiment_tw_5.4.2_3.0_1724419358561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_hotel_review_sentiment","tw") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_hotel_review_sentiment","tw") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hotel_review_sentiment| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|tw| +|Size:|1.0 GB| + +## References + +References + +- https://huggingface.co/clhuang/t5-hotel-review-sentiment \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_en.md new file mode 100644 index 00000000000000..826bc77163f926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_informal_s_nlp T5Transformer from s-nlp +author: John Snow Labs +name: t5_informal_s_nlp +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_informal_s_nlp` is a English model originally trained by s-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_informal_s_nlp_en_5.4.2_3.0_1724427542224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_informal_s_nlp_en_5.4.2_3.0_1724427542224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_informal_s_nlp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_informal_s_nlp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_informal_s_nlp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/s-nlp/t5-informal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_pipeline_en.md new file mode 100644 index 00000000000000..f14ddd44966212 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_informal_s_nlp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_informal_s_nlp_pipeline pipeline T5Transformer from s-nlp +author: John Snow Labs +name: t5_informal_s_nlp_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_informal_s_nlp_pipeline` is a English model originally trained by s-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_informal_s_nlp_pipeline_en_5.4.2_3.0_1724427590795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_informal_s_nlp_pipeline_en_5.4.2_3.0_1724427590795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_informal_s_nlp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_informal_s_nlp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_informal_s_nlp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/s-nlp/t5-informal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_kk.md b/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_kk.md new file mode 100644 index 00000000000000..4b8bb8d538527b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_kk.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Kazakh t5_kazakh_qa T5Transformer from Kyrmasch +author: John Snow Labs +name: t5_kazakh_qa +date: 2024-08-23 +tags: [kk, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: kk +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_kazakh_qa` is a Kazakh model originally trained by Kyrmasch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_kazakh_qa_kk_5.4.2_3.0_1724429556243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_kazakh_qa_kk_5.4.2_3.0_1724429556243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_kazakh_qa","kk") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_kazakh_qa", "kk") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_kazakh_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|kk| +|Size:|2.9 GB| + +## References + +https://huggingface.co/Kyrmasch/t5-kazakh-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_pipeline_kk.md b/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_pipeline_kk.md new file mode 100644 index 00000000000000..031fd88729ce59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_kazakh_qa_pipeline_kk.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Kazakh t5_kazakh_qa_pipeline pipeline T5Transformer from Kyrmasch +author: John Snow Labs +name: t5_kazakh_qa_pipeline +date: 2024-08-23 +tags: [kk, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: kk +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_kazakh_qa_pipeline` is a Kazakh model originally trained by Kyrmasch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_kazakh_qa_pipeline_kk_5.4.2_3.0_1724429692456.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_kazakh_qa_pipeline_kk_5.4.2_3.0_1724429692456.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_kazakh_qa_pipeline", lang = "kk") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_kazakh_qa_pipeline", lang = "kk") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_kazakh_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|kk| +|Size:|2.9 GB| + +## References + +https://huggingface.co/Kyrmasch/t5-kazakh-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_en.md new file mode 100644 index 00000000000000..0cc1e7239845b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_en.md @@ -0,0 +1,93 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from ml6team) +author: John Snow Labs +name: t5_keyphrase_generation_small_openkp +date: 2024-08-23 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `keyphrase-generation-t5-small-openkp` is a English model originally trained by `ml6team`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_keyphrase_generation_small_openkp_en_5.4.2_3.0_1724420884671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_keyphrase_generation_small_openkp_en_5.4.2_3.0_1724420884671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_keyphrase_generation_small_openkp","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_keyphrase_generation_small_openkp","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_keyphrase_generation_small_openkp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.8 MB| + +## References + +References + +- https://huggingface.co/ml6team/keyphrase-generation-t5-small-openkp +- https://github.com/microsoft/OpenKP +- https://arxiv.org/abs/1911.02671 +- https://paperswithcode.com/sota?task=Keyphrase+Generation&dataset=openkp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_pipeline_en.md new file mode 100644 index 00000000000000..4c8d933667e217 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_keyphrase_generation_small_openkp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_keyphrase_generation_small_openkp_pipeline pipeline T5Transformer from ml6team +author: John Snow Labs +name: t5_keyphrase_generation_small_openkp_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_keyphrase_generation_small_openkp_pipeline` is a English model originally trained by ml6team. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_keyphrase_generation_small_openkp_pipeline_en_5.4.2_3.0_1724420902250.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_keyphrase_generation_small_openkp_pipeline_en_5.4.2_3.0_1724420902250.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_keyphrase_generation_small_openkp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_keyphrase_generation_small_openkp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_keyphrase_generation_small_openkp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/ml6team/keyphrase-generation-t5-small-openkp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_en.md new file mode 100644 index 00000000000000..4475c09f19dfb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_finetuned_amazon_test T5Transformer from NICFRU +author: John Snow Labs +name: t5_large_finetuned_amazon_test +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_finetuned_amazon_test` is a English model originally trained by NICFRU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_amazon_test_en_5.4.2_3.0_1724449794605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_amazon_test_en_5.4.2_3.0_1724449794605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_finetuned_amazon_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_finetuned_amazon_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_finetuned_amazon_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/NICFRU/t5-large-finetuned-amazon-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_pipeline_en.md new file mode 100644 index 00000000000000..568185dcca15f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_finetuned_amazon_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_finetuned_amazon_test_pipeline pipeline T5Transformer from NICFRU +author: John Snow Labs +name: t5_large_finetuned_amazon_test_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_finetuned_amazon_test_pipeline` is a English model originally trained by NICFRU. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_amazon_test_pipeline_en_5.4.2_3.0_1724449930617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_amazon_test_pipeline_en_5.4.2_3.0_1724449930617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_finetuned_amazon_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_finetuned_amazon_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_finetuned_amazon_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/NICFRU/t5-large-finetuned-amazon-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_jung_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_jung_en.md new file mode 100644 index 00000000000000..86d253e4383808 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_jung_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_jung T5Transformer from Jung +author: John Snow Labs +name: t5_large_jung +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_jung` is a English model originally trained by Jung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_jung_en_5.4.2_3.0_1724434270460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_jung_en_5.4.2_3.0_1724434270460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_jung","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_jung", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_jung| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Jung/t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_en.md new file mode 100644 index 00000000000000..162d186f368705 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_qa_8_qa_8 T5Transformer from badokorach +author: John Snow Labs +name: t5_large_qa_8_qa_8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_qa_8_qa_8` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_qa_8_en_5.4.2_3.0_1724455977694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_qa_8_en_5.4.2_3.0_1724455977694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_qa_8_qa_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_qa_8_qa_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_qa_8_qa_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.7 MB| + +## References + +https://huggingface.co/badokorach/t5-large-qa-8-qa-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_pipeline_en.md new file mode 100644 index 00000000000000..6bcd1429095598 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_qa_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_qa_8_qa_8_pipeline pipeline T5Transformer from badokorach +author: John Snow Labs +name: t5_large_qa_8_qa_8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_qa_8_qa_8_pipeline` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_qa_8_pipeline_en_5.4.2_3.0_1724455994485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_qa_8_pipeline_en_5.4.2_3.0_1724455994485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_qa_8_qa_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_qa_8_qa_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_qa_8_qa_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.7 MB| + +## References + +https://huggingface.co/badokorach/t5-large-qa-8-qa-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_en.md new file mode 100644 index 00000000000000..5a6c0db8b6cd30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_squad_qg_default T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squad_qg_default +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qg_default` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_default_en_5.4.2_3.0_1724437961061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_default_en_5.4.2_3.0_1724437961061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_squad_qg_default","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_squad_qg_default", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qg_default| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squad-qg-default \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_pipeline_en.md new file mode 100644 index 00000000000000..5e14c11a981b44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_default_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_squad_qg_default_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squad_qg_default_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qg_default_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_default_pipeline_en_5.4.2_3.0_1724438092342.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_default_pipeline_en_5.4.2_3.0_1724438092342.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_squad_qg_default_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_squad_qg_default_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qg_default_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squad-qg-default + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_en.md new file mode 100644 index 00000000000000..2103be4defc8e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_squad_qg T5Transformer from lmqg +author: John Snow Labs +name: t5_large_squad_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qg` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_en_5.4.2_3.0_1724423071484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_en_5.4.2_3.0_1724423071484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_squad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_squad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_pipeline_en.md new file mode 100644 index 00000000000000..374651bf055617 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_squad_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_squad_qg_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_large_squad_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qg_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_pipeline_en_5.4.2_3.0_1724423211737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qg_pipeline_en_5.4.2_3.0_1724423211737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_squad_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_squad_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-squad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_en.md new file mode 100644 index 00000000000000..3db62aa276853e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_subjqa_restaurants_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_restaurants_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_restaurants_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_restaurants_qg_en_5.4.2_3.0_1724436747224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_restaurants_qg_en_5.4.2_3.0_1724436747224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_subjqa_restaurants_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_subjqa_restaurants_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_restaurants_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-restaurants-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_pipeline_en.md new file mode 100644 index 00000000000000..fe44446062d194 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_restaurants_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_subjqa_restaurants_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_restaurants_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_restaurants_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_restaurants_qg_pipeline_en_5.4.2_3.0_1724436906619.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_restaurants_qg_pipeline_en_5.4.2_3.0_1724436906619.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_subjqa_restaurants_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_subjqa_restaurants_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_restaurants_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-restaurants-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_winogrande_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_winogrande_en.md new file mode 100644 index 00000000000000..b919e164f4de8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_winogrande_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_winogrande T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_winogrande +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_winogrande` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_winogrande_en_5.4.2_3.0_1724442869514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_winogrande_en_5.4.2_3.0_1724442869514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_winogrande","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_winogrande", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_winogrande| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-winogrande \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_en.md new file mode 100644 index 00000000000000..fd84e08f0c1ccc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_feedback_0810 T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_0810 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_0810` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0810_en_5.4.2_3.0_1724452187623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0810_en_5.4.2_3.0_1724452187623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_feedback_0810","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_feedback_0810", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_0810| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|977.4 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-0810 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_pipeline_en.md new file mode 100644 index 00000000000000..95daea94aa2e83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_model_1_feedback_0810_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_feedback_0810_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_0810_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_0810_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0810_pipeline_en_5.4.2_3.0_1724452237946.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0810_pipeline_en_5.4.2_3.0_1724452237946.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_feedback_0810_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_feedback_0810_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_0810_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|977.4 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-0810 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_en.md new file mode 100644 index 00000000000000..a308a6b04b3da1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_en.md @@ -0,0 +1,96 @@ +--- +layout: model +title: English T5ForConditionalGeneration Base Cased model (from doc2query) +author: John Snow Labs +name: t5_msmarco_base_v1 +date: 2024-08-23 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `msmarco-t5-base-v1` is a English model originally trained by `doc2query`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_msmarco_base_v1_en_5.4.2_3.0_1724421543595.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_msmarco_base_v1_en_5.4.2_3.0_1724421543595.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_msmarco_base_v1","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_msmarco_base_v1","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_msmarco_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +References + +- https://huggingface.co/doc2query/msmarco-t5-base-v1 +- https://arxiv.org/abs/1904.08375 +- https://cs.uwaterloo.ca/~jimmylin/publications/Nogueira_Lin_2019_docTTTTTquery-v2.pdf +- https://arxiv.org/abs/2104.08663 +- https://github.com/UKPLab/beir +- https://www.sbert.net/examples/unsupervised_learning/query_generation/README.html +- https://github.com/microsoft/MSMARCO-Passage-Ranking \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_pipeline_en.md new file mode 100644 index 00000000000000..edcaf0422a2b32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_msmarco_base_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_msmarco_base_v1_pipeline pipeline T5Transformer from doc2query +author: John Snow Labs +name: t5_msmarco_base_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_msmarco_base_v1_pipeline` is a English model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_msmarco_base_v1_pipeline_en_5.4.2_3.0_1724421661757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_msmarco_base_v1_pipeline_en_5.4.2_3.0_1724421661757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_msmarco_base_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_msmarco_base_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_msmarco_base_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/doc2query/msmarco-t5-base-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_en.md new file mode 100644 index 00000000000000..73011eae6f4bb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_paraphraser_valurank T5Transformer from valurank +author: John Snow Labs +name: t5_paraphraser_valurank +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphraser_valurank` is a English model originally trained by valurank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphraser_valurank_en_5.4.2_3.0_1724419533690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphraser_valurank_en_5.4.2_3.0_1724419533690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_paraphraser_valurank","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_paraphraser_valurank", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphraser_valurank| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valurank/t5-paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_pipeline_en.md new file mode 100644 index 00000000000000..2c08ad9b69e015 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_paraphraser_valurank_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_paraphraser_valurank_pipeline pipeline T5Transformer from valurank +author: John Snow Labs +name: t5_paraphraser_valurank_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphraser_valurank_pipeline` is a English model originally trained by valurank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphraser_valurank_pipeline_en_5.4.2_3.0_1724419584037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphraser_valurank_pipeline_en_5.4.2_3.0_1724419584037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_paraphraser_valurank_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_paraphraser_valurank_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphraser_valurank_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valurank/t5-paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_en.md new file mode 100644 index 00000000000000..6735db1dceed0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_senthil3226w T5Transformer from senthil3226w +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_senthil3226w +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_senthil3226w` is a English model originally trained by senthil3226w. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_senthil3226w_en_5.4.2_3.0_1724433813666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_senthil3226w_en_5.4.2_3.0_1724433813666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_senthil3226w","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_senthil3226w", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_senthil3226w| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/senthil3226w/t5_recommendation_sports_equipment_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_pipeline_en.md new file mode 100644 index 00000000000000..03fa75ec28c22b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_recommendation_sports_equipment_english_senthil3226w_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_senthil3226w_pipeline pipeline T5Transformer from senthil3226w +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_senthil3226w_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_senthil3226w_pipeline` is a English model originally trained by senthil3226w. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_senthil3226w_pipeline_en_5.4.2_3.0_1724434025791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_senthil3226w_pipeline_en_5.4.2_3.0_1724434025791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_sports_equipment_english_senthil3226w_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_sports_equipment_english_senthil3226w_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_senthil3226w_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/senthil3226w/t5_recommendation_sports_equipment_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_en.md new file mode 100644 index 00000000000000..166cacce18482e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_shubham09 T5Transformer from Shubham09 +author: John Snow Labs +name: t5_shubham09 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_shubham09` is a English model originally trained by Shubham09. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_shubham09_en_5.4.2_3.0_1724409502407.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_shubham09_en_5.4.2_3.0_1724409502407.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_shubham09","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_shubham09", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_shubham09| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|805.3 MB| + +## References + +https://huggingface.co/Shubham09/T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_pipeline_en.md new file mode 100644 index 00000000000000..ab76b735cc0bf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_shubham09_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_shubham09_pipeline pipeline T5Transformer from Shubham09 +author: John Snow Labs +name: t5_shubham09_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_shubham09_pipeline` is a English model originally trained by Shubham09. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_shubham09_pipeline_en_5.4.2_3.0_1724409600141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_shubham09_pipeline_en_5.4.2_3.0_1724409600141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_shubham09_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_shubham09_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_shubham09_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|805.3 MB| + +## References + +https://huggingface.co/Shubham09/T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_en.md new file mode 100644 index 00000000000000..6abcd85685d86d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_billsum_catalan T5Transformer from Trisert +author: John Snow Labs +name: t5_small_billsum_catalan +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_billsum_catalan` is a English model originally trained by Trisert. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_billsum_catalan_en_5.4.2_3.0_1724443905224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_billsum_catalan_en_5.4.2_3.0_1724443905224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_billsum_catalan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_billsum_catalan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_billsum_catalan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|318.0 MB| + +## References + +https://huggingface.co/Trisert/t5-small-billsum-ca \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_pipeline_en.md new file mode 100644 index 00000000000000..25166c77459794 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_billsum_catalan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_billsum_catalan_pipeline pipeline T5Transformer from Trisert +author: John Snow Labs +name: t5_small_billsum_catalan_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_billsum_catalan_pipeline` is a English model originally trained by Trisert. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_billsum_catalan_pipeline_en_5.4.2_3.0_1724443925203.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_billsum_catalan_pipeline_en_5.4.2_3.0_1724443925203.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_billsum_catalan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_billsum_catalan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_billsum_catalan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.0 MB| + +## References + +https://huggingface.co/Trisert/t5-small-billsum-ca + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_en.md new file mode 100644 index 00000000000000..08af63a875d2b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_crows_pairs_finetuned T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_crows_pairs_finetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_crows_pairs_finetuned` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_en_5.4.2_3.0_1724455247575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_en_5.4.2_3.0_1724455247575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_crows_pairs_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_crows_pairs_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_crows_pairs_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.8 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_crows_pairs_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..ae621b3377aa3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_crows_pairs_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_crows_pairs_finetuned_pipeline pipeline T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_crows_pairs_finetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_crows_pairs_finetuned_pipeline` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_pipeline_en_5.4.2_3.0_1724455274627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_pipeline_en_5.4.2_3.0_1724455274627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_crows_pairs_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_crows_pairs_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_crows_pairs_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.8 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_crows_pairs_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_en.md new file mode 100644 index 00000000000000..6259c76bb17395 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_detoxify T5Transformer from the-hir0 +author: John Snow Labs +name: t5_small_detoxify +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_detoxify` is a English model originally trained by the-hir0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_detoxify_en_5.4.2_3.0_1724434507534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_detoxify_en_5.4.2_3.0_1724434507534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_detoxify","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_detoxify", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_detoxify| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.3 MB| + +## References + +https://huggingface.co/the-hir0/t5-small-detoxify \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_pipeline_en.md new file mode 100644 index 00000000000000..2875c684019ea8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_detoxify_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_detoxify_pipeline pipeline T5Transformer from the-hir0 +author: John Snow Labs +name: t5_small_detoxify_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_detoxify_pipeline` is a English model originally trained by the-hir0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_detoxify_pipeline_en_5.4.2_3.0_1724434525910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_detoxify_pipeline_en_5.4.2_3.0_1724434525910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_detoxify_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_detoxify_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_detoxify_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.3 MB| + +## References + +https://huggingface.co/the-hir0/t5-small-detoxify + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_en.md new file mode 100644 index 00000000000000..9b51debc442239 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_dratinox T5Transformer from dratinox +author: John Snow Labs +name: t5_small_dratinox +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_dratinox` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_dratinox_en_5.4.2_3.0_1724441898686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_dratinox_en_5.4.2_3.0_1724441898686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_dratinox","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_dratinox", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_dratinox| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|319.2 MB| + +## References + +https://huggingface.co/dratinox/t5_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_pipeline_en.md new file mode 100644 index 00000000000000..c07691f06a04c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_dratinox_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_dratinox_pipeline pipeline T5Transformer from dratinox +author: John Snow Labs +name: t5_small_dratinox_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_dratinox_pipeline` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_dratinox_pipeline_en_5.4.2_3.0_1724441920852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_dratinox_pipeline_en_5.4.2_3.0_1724441920852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_dratinox_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_dratinox_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_dratinox_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|319.2 MB| + +## References + +https://huggingface.co/dratinox/t5_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_en.md new file mode 100644 index 00000000000000..f9c317807dcff2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_e2e_qg T5Transformer from valhalla +author: John Snow Labs +name: t5_small_e2e_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_e2e_qg` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qg_en_5.4.2_3.0_1724419234159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qg_en_5.4.2_3.0_1724419234159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_e2e_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_e2e_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_e2e_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/valhalla/t5-small-e2e-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_pipeline_en.md new file mode 100644 index 00000000000000..b7440602269074 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_e2e_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_e2e_qg_pipeline pipeline T5Transformer from valhalla +author: John Snow Labs +name: t5_small_e2e_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_e2e_qg_pipeline` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qg_pipeline_en_5.4.2_3.0_1724419252513.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qg_pipeline_en_5.4.2_3.0_1724419252513.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_e2e_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_e2e_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_e2e_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/valhalla/t5-small-e2e-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_en.md new file mode 100644 index 00000000000000..24467f742ba0b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_enterpret_finetuned T5Transformer from AravindKumarRajendran +author: John Snow Labs +name: t5_small_enterpret_finetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_enterpret_finetuned` is a English model originally trained by AravindKumarRajendran. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_enterpret_finetuned_en_5.4.2_3.0_1724439588214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_enterpret_finetuned_en_5.4.2_3.0_1724439588214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_enterpret_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_enterpret_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_enterpret_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.3 MB| + +## References + +https://huggingface.co/AravindKumarRajendran/t5-small-enterpret-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..37a91702040da8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_enterpret_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_enterpret_finetuned_pipeline pipeline T5Transformer from AravindKumarRajendran +author: John Snow Labs +name: t5_small_enterpret_finetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_enterpret_finetuned_pipeline` is a English model originally trained by AravindKumarRajendran. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_enterpret_finetuned_pipeline_en_5.4.2_3.0_1724439607557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_enterpret_finetuned_pipeline_en_5.4.2_3.0_1724439607557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_enterpret_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_enterpret_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_enterpret_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.3 MB| + +## References + +https://huggingface.co/AravindKumarRajendran/t5-small-enterpret-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_en.md new file mode 100644 index 00000000000000..77868651a1b8c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_italian_b32 T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_italian_b32 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_italian_b32` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_b32_en_5.4.2_3.0_1724448724543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_b32_en_5.4.2_3.0_1724448724543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_italian_b32","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_italian_b32", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_italian_b32| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.3 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-en-to-it-b32 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline_en.md new file mode 100644 index 00000000000000..7c5b5bc5d547da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline_en_5.4.2_3.0_1724448741321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline_en_5.4.2_3.0_1724448741321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_italian_b32_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.3 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-en-to-it-b32 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_en.md new file mode 100644 index 00000000000000..51d483b662a3e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro T5Transformer from giolisandro +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro` is a English model originally trained by giolisandro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_en_5.4.2_3.0_1724417411777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_en_5.4.2_3.0_1724417411777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|311.2 MB| + +## References + +https://huggingface.co/giolisandro/t5-small-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline_en.md new file mode 100644 index 00000000000000..0502da41685cda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline pipeline T5Transformer from giolisandro +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline` is a English model originally trained by giolisandro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline_en_5.4.2_3.0_1724417431711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline_en_5.4.2_3.0_1724417431711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_giolisandro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|311.2 MB| + +## References + +https://huggingface.co/giolisandro/t5-small-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_en.md new file mode 100644 index 00000000000000..6e37751944f3c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle T5Transformer from Mirelle +author: John Snow Labs +name: t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle` is a English model originally trained by Mirelle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_en_5.4.2_3.0_1724444076597.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_en_5.4.2_3.0_1724444076597.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Mirelle/t5-small-finetuned-ro-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline_en.md new file mode 100644 index 00000000000000..c2a27da9505343 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline pipeline T5Transformer from Mirelle +author: John Snow Labs +name: t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline` is a English model originally trained by Mirelle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline_en_5.4.2_3.0_1724444093824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline_en_5.4.2_3.0_1724444093824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_romanian_tonga_tonga_islands_english_mirelle_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Mirelle/t5-small-finetuned-ro-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_en.md new file mode 100644 index 00000000000000..67bfa60c958a03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_conclusion T5Transformer from fanzru +author: John Snow Labs +name: t5_small_finetuned_xsum_conclusion +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_conclusion` is a English model originally trained by fanzru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_conclusion_en_5.4.2_3.0_1724416913202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_conclusion_en_5.4.2_3.0_1724416913202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_conclusion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_conclusion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_conclusion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/fanzru/t5-small-finetuned-xsum-conclusion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_pipeline_en.md new file mode 100644 index 00000000000000..fa73286838640a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_conclusion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_conclusion_pipeline pipeline T5Transformer from fanzru +author: John Snow Labs +name: t5_small_finetuned_xsum_conclusion_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_conclusion_pipeline` is a English model originally trained by fanzru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_conclusion_pipeline_en_5.4.2_3.0_1724416929795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_conclusion_pipeline_en_5.4.2_3.0_1724416929795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_conclusion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_conclusion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_conclusion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/fanzru/t5-small-finetuned-xsum-conclusion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_en.md new file mode 100644 index 00000000000000..add1d0d1921b08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_itsmayur T5Transformer from ItsMayur +author: John Snow Labs +name: t5_small_finetuned_xsum_itsmayur +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_itsmayur` is a English model originally trained by ItsMayur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_itsmayur_en_5.4.2_3.0_1724416922878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_itsmayur_en_5.4.2_3.0_1724416922878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_itsmayur","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_itsmayur", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_itsmayur| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|295.6 MB| + +## References + +https://huggingface.co/ItsMayur/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_pipeline_en.md new file mode 100644 index 00000000000000..e1bc6f4f65fa5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_itsmayur_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_itsmayur_pipeline pipeline T5Transformer from ItsMayur +author: John Snow Labs +name: t5_small_finetuned_xsum_itsmayur_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_itsmayur_pipeline` is a English model originally trained by ItsMayur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_itsmayur_pipeline_en_5.4.2_3.0_1724416949213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_itsmayur_pipeline_en_5.4.2_3.0_1724416949213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_itsmayur_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_itsmayur_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_itsmayur_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|295.6 MB| + +## References + +https://huggingface.co/ItsMayur/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_en.md new file mode 100644 index 00000000000000..8c5a8b24f2edbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_mfaraggg T5Transformer from mfaraggg +author: John Snow Labs +name: t5_small_finetuned_xsum_mfaraggg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_mfaraggg` is a English model originally trained by mfaraggg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_mfaraggg_en_5.4.2_3.0_1724456876050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_mfaraggg_en_5.4.2_3.0_1724456876050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_mfaraggg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_mfaraggg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_mfaraggg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/mfaraggg/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_pipeline_en.md new file mode 100644 index 00000000000000..fb2fd3a67f2106 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_mfaraggg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_mfaraggg_pipeline pipeline T5Transformer from mfaraggg +author: John Snow Labs +name: t5_small_finetuned_xsum_mfaraggg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_mfaraggg_pipeline` is a English model originally trained by mfaraggg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_mfaraggg_pipeline_en_5.4.2_3.0_1724456895173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_mfaraggg_pipeline_en_5.4.2_3.0_1724456895173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_mfaraggg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_mfaraggg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_mfaraggg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/mfaraggg/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_en.md new file mode 100644 index 00000000000000..459f09e1815a06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_pien_27 T5Transformer from pien-27 +author: John Snow Labs +name: t5_small_finetuned_xsum_pien_27 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_pien_27` is a English model originally trained by pien-27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_pien_27_en_5.4.2_3.0_1724407863080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_pien_27_en_5.4.2_3.0_1724407863080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_pien_27","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_pien_27", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_pien_27| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/pien-27/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_pipeline_en.md new file mode 100644 index 00000000000000..c6ff801e9f54b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_pien_27_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_pien_27_pipeline pipeline T5Transformer from pien-27 +author: John Snow Labs +name: t5_small_finetuned_xsum_pien_27_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_pien_27_pipeline` is a English model originally trained by pien-27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_pien_27_pipeline_en_5.4.2_3.0_1724407883175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_pien_27_pipeline_en_5.4.2_3.0_1724407883175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_pien_27_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_pien_27_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_pien_27_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/pien-27/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_en.md new file mode 100644 index 00000000000000..f9c8324d636af0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_poll_generation T5Transformer from Pedrambbk +author: John Snow Labs +name: t5_small_poll_generation +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_poll_generation` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_poll_generation_en_5.4.2_3.0_1724410496248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_poll_generation_en_5.4.2_3.0_1724410496248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_poll_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_poll_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_poll_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.5 MB| + +## References + +https://huggingface.co/Pedrambbk/T5-small-poll-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_pipeline_en.md new file mode 100644 index 00000000000000..579bb2b6a408cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_poll_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_poll_generation_pipeline pipeline T5Transformer from Pedrambbk +author: John Snow Labs +name: t5_small_poll_generation_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_poll_generation_pipeline` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_poll_generation_pipeline_en_5.4.2_3.0_1724410517480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_poll_generation_pipeline_en_5.4.2_3.0_1724410517480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_poll_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_poll_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_poll_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.5 MB| + +## References + +https://huggingface.co/Pedrambbk/T5-small-poll-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_en.md new file mode 100644 index 00000000000000..bcc24f1eb366f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qa_9 T5Transformer from badokorach +author: John Snow Labs +name: t5_small_qa_9 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qa_9` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qa_9_en_5.4.2_3.0_1724448905534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qa_9_en_5.4.2_3.0_1724448905534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qa_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qa_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qa_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/badokorach/t5-small-qa-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_pipeline_en.md new file mode 100644 index 00000000000000..b62d3793e8b646 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qa_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qa_9_pipeline pipeline T5Transformer from badokorach +author: John Snow Labs +name: t5_small_qa_9_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qa_9_pipeline` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qa_9_pipeline_en_5.4.2_3.0_1724448930222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qa_9_pipeline_en_5.4.2_3.0_1724448930222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qa_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qa_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qa_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/badokorach/t5-small-qa-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_en.md new file mode 100644 index 00000000000000..eb0a257628d54b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_hl T5Transformer from valhalla +author: John Snow Labs +name: t5_small_qg_hl +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_hl` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_hl_en_5.4.2_3.0_1724420902649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_hl_en_5.4.2_3.0_1724420902649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_hl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_hl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_hl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/valhalla/t5-small-qg-hl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_pipeline_en.md new file mode 100644 index 00000000000000..61ba154576e0c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_hl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_hl_pipeline pipeline T5Transformer from valhalla +author: John Snow Labs +name: t5_small_qg_hl_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_hl_pipeline` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_hl_pipeline_en_5.4.2_3.0_1724420922958.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_hl_pipeline_en_5.4.2_3.0_1724420922958.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_hl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_hl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_hl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/valhalla/t5-small-qg-hl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_squad_qg_ae_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_squad_qg_ae_pipeline_en.md new file mode 100644 index 00000000000000..3bc1b99d7a7054 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_squad_qg_ae_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qg_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_small_squad_qg_ae_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_ae_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_ae_pipeline_en_5.4.2_3.0_1724422650284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_ae_pipeline_en_5.4.2_3.0_1724422650284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qg_ae_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qg_ae_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/lmqg/t5-small-squad-qg-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_en.md new file mode 100644 index 00000000000000..af805f55357715 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_subjqa_vanilla_grocery_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_vanilla_grocery_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_vanilla_grocery_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724455910098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724455910098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_subjqa_vanilla_grocery_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_subjqa_vanilla_grocery_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_vanilla_grocery_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|318.6 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-vanilla-grocery-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_pipeline_en.md new file mode 100644 index 00000000000000..9b76e65278aa07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_subjqa_vanilla_grocery_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_subjqa_vanilla_grocery_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_vanilla_grocery_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_vanilla_grocery_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724455932736.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724455932736.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_vanilla_grocery_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.6 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-vanilla-grocery-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_en.md new file mode 100644 index 00000000000000..61453bd3bb8329 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_wikilarge_newsela_with_domain_adaptation T5Transformer from bogdancazan +author: John Snow Labs +name: t5_small_wikilarge_newsela_with_domain_adaptation +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_wikilarge_newsela_with_domain_adaptation` is a English model originally trained by bogdancazan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_wikilarge_newsela_with_domain_adaptation_en_5.4.2_3.0_1724444368354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_wikilarge_newsela_with_domain_adaptation_en_5.4.2_3.0_1724444368354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_wikilarge_newsela_with_domain_adaptation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_wikilarge_newsela_with_domain_adaptation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_wikilarge_newsela_with_domain_adaptation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/bogdancazan/t5-small-wikilarge-newsela-with-domain-adaptation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_pipeline_en.md new file mode 100644 index 00000000000000..60e0014d221471 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_wikilarge_newsela_with_domain_adaptation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_wikilarge_newsela_with_domain_adaptation_pipeline pipeline T5Transformer from bogdancazan +author: John Snow Labs +name: t5_small_wikilarge_newsela_with_domain_adaptation_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_wikilarge_newsela_with_domain_adaptation_pipeline` is a English model originally trained by bogdancazan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_wikilarge_newsela_with_domain_adaptation_pipeline_en_5.4.2_3.0_1724444385585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_wikilarge_newsela_with_domain_adaptation_pipeline_en_5.4.2_3.0_1724444385585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_wikilarge_newsela_with_domain_adaptation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_wikilarge_newsela_with_domain_adaptation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_wikilarge_newsela_with_domain_adaptation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/bogdancazan/t5-small-wikilarge-newsela-with-domain-adaptation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_en.md new file mode 100644 index 00000000000000..00db1c5c3645fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_winobias_finetuned T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_winobias_finetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_winobias_finetuned` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_en_5.4.2_3.0_1724445977307.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_en_5.4.2_3.0_1724445977307.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_winobias_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_winobias_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_winobias_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|309.4 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_winobias_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..a9ac088a16dcb3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_winobias_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_winobias_finetuned_pipeline pipeline T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_winobias_finetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_winobias_finetuned_pipeline` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_pipeline_en_5.4.2_3.0_1724446002786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_pipeline_en_5.4.2_3.0_1724446002786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_winobias_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_winobias_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_winobias_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|309.4 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_winobias_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_en.md new file mode 100644 index 00000000000000..7ff3faa223c634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_sum_checkpoint_2200 T5Transformer from user336 +author: John Snow Labs +name: t5_sum_checkpoint_2200 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sum_checkpoint_2200` is a English model originally trained by user336. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sum_checkpoint_2200_en_5.4.2_3.0_1724437177861.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sum_checkpoint_2200_en_5.4.2_3.0_1724437177861.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_sum_checkpoint_2200","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_sum_checkpoint_2200", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sum_checkpoint_2200| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/user336/t5-sum-checkpoint-2200 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_pipeline_en.md new file mode 100644 index 00000000000000..8f39bb008f0c9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_checkpoint_2200_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_sum_checkpoint_2200_pipeline pipeline T5Transformer from user336 +author: John Snow Labs +name: t5_sum_checkpoint_2200_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sum_checkpoint_2200_pipeline` is a English model originally trained by user336. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sum_checkpoint_2200_pipeline_en_5.4.2_3.0_1724437225384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sum_checkpoint_2200_pipeline_en_5.4.2_3.0_1724437225384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_sum_checkpoint_2200_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_sum_checkpoint_2200_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sum_checkpoint_2200_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/user336/t5-sum-checkpoint-2200 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_fi.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_fi.md new file mode 100644 index 00000000000000..3d4972ab48811a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_fi.md @@ -0,0 +1,106 @@ +--- +layout: model +title: Finnish T5ForConditionalGeneration Tiny Cased model (from Finnish-NLP) +author: John Snow Labs +name: t5_tiny_nl6 +date: 2024-08-23 +tags: [fi, open_source, t5, onnx] +task: Text Generation +language: fi +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-tiny-nl6-finnish` is a Finnish model originally trained by `Finnish-NLP`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_nl6_fi_5.4.2_3.0_1724420293223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_nl6_fi_5.4.2_3.0_1724420293223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_tiny_nl6","fi") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_nl6","fi") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_nl6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fi| +|Size:|145.7 MB| + +## References + +References + +- https://huggingface.co/Finnish-NLP/t5-tiny-nl6-finnish +- https://arxiv.org/abs/1910.10683 +- https://github.com/google-research/text-to-text-transfer-transformer +- https://github.com/google-research/text-to-text-transfer-transformer/blob/main/released_checkpoints.md#t511 +- https://arxiv.org/abs/2002.05202 +- https://arxiv.org/abs/2109.10686 +- http://urn.fi/urn:nbn:fi:lb-2017070501 +- http://urn.fi/urn:nbn:fi:lb-2021050401 +- http://urn.fi/urn:nbn:fi:lb-2018121001 +- http://urn.fi/urn:nbn:fi:lb-2020021803 +- https://sites.research.google/trc/about/ +- https://github.com/google-research/t5x +- https://github.com/spyysalo/yle-corpus +- https://github.com/aajanki/eduskunta-vkk +- https://sites.research.google/trc/ +- https://www.linkedin.com/in/aapotanskanen/ +- https://www.linkedin.com/in/rasmustoivanen/ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_pipeline_fi.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_pipeline_fi.md new file mode 100644 index 00000000000000..cc21d413c1ae06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_nl6_pipeline_fi.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Finnish t5_tiny_nl6_pipeline pipeline T5Transformer from Finnish-NLP +author: John Snow Labs +name: t5_tiny_nl6_pipeline +date: 2024-08-23 +tags: [fi, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fi +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_nl6_pipeline` is a Finnish model originally trained by Finnish-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_nl6_pipeline_fi_5.4.2_3.0_1724420300197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_nl6_pipeline_fi_5.4.2_3.0_1724420300197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_nl6_pipeline", lang = "fi") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_nl6_pipeline", lang = "fi") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_nl6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fi| +|Size:|145.7 MB| + +## References + +https://huggingface.co/Finnish-NLP/t5-tiny-nl6-finnish + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md new file mode 100644 index 00000000000000..65a7df14b73553 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724456729738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724456729738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-1e-05-weight_decay-0.01-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md new file mode 100644 index 00000000000000..c2b335a0830335 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline pipeline T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724456731320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724456731320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_1e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-1e-05-weight_decay-0.01-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md new file mode 100644 index 00000000000000..1683fe73320e55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724427008774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724427008774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.01-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md new file mode 100644 index 00000000000000..da06e4a3fd4642 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline pipeline T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724427010333.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724427010333.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.01-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_pipeline_xx.md new file mode 100644 index 00000000000000..00d213e34fcdb9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual t5_translation_en2pt_pipeline pipeline T5Transformer from unicamp-dl +author: John Snow Labs +name: t5_translation_en2pt_pipeline +date: 2024-08-23 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_translation_en2pt_pipeline` is a Multilingual model originally trained by unicamp-dl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_translation_en2pt_pipeline_xx_5.4.2_3.0_1724421907979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_translation_en2pt_pipeline_xx_5.4.2_3.0_1724421907979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_translation_en2pt_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_translation_en2pt_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_translation_en2pt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|1.0 GB| + +## References + +https://huggingface.co/unicamp-dl/translation-en-pt-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_xx.md b/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_xx.md new file mode 100644 index 00000000000000..95b3f357b6a39d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_translation_en2pt_xx.md @@ -0,0 +1,92 @@ +--- +layout: model +title: Multilingual T5ForConditionalGeneration Cased model (from unicamp-dl) +author: John Snow Labs +name: t5_translation_en2pt +date: 2024-08-23 +tags: [pt, en, open_source, t5, xx, onnx] +task: Text Generation +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `translation-en-pt-t5` is a Multilingual model originally trained by `unicamp-dl`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_translation_en2pt_xx_5.4.2_3.0_1724421860877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_translation_en2pt_xx_5.4.2_3.0_1724421860877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_translation_en2pt","xx") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_translation_en2pt","xx") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_translation_en2pt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|1.0 GB| + +## References + +References + +- https://huggingface.co/unicamp-dl/translation-en-pt-t5 +- https://github.com/unicamp-dl/Lite-T5-Translation +- https://aclanthology.org/2020.wmt-1.90.pdf \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_v1_1_large_gramatika1500k_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_v1_1_large_gramatika1500k_en.md new file mode 100644 index 00000000000000..a75b31af70ea97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_v1_1_large_gramatika1500k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_large_gramatika1500k T5Transformer from jeremyvictor +author: John Snow Labs +name: t5_v1_1_large_gramatika1500k +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_gramatika1500k` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika1500k_en_5.4.2_3.0_1724446874873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika1500k_en_5.4.2_3.0_1724446874873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_large_gramatika1500k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_large_gramatika1500k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_gramatika1500k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/jeremyvictor/t5-v1_1-large-gramatika1500k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_en.md new file mode 100644 index 00000000000000..bd391cf3f18a7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_addsent_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_addsent_0 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_addsent_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_0_en_5.4.2_3.0_1724410893100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_0_en_5.4.2_3.0_1724410893100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_addsent_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_addsent_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_addsent_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_addsent_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_pipeline_en.md new file mode 100644 index 00000000000000..314525c4e83419 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_addsent_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_addsent_0_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_addsent_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_0_pipeline_en_5.4.2_3.0_1724411033550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_0_pipeline_en_5.4.2_3.0_1724411033550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_addsent_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_addsent_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_addsent_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_addsent_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_en.md new file mode 100644 index 00000000000000..85a9d348395686 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_md5_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_md5_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_md5_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_md5_1_en_5.4.2_3.0_1724445919367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_md5_1_en_5.4.2_3.0_1724445919367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_md5_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_md5_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_md5_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_md5_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_pipeline_en.md new file mode 100644 index 00000000000000..5e1978f4dee901 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_adv_md5_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_md5_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_md5_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_md5_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_md5_1_pipeline_en_5.4.2_3.0_1724446061689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_md5_1_pipeline_en_5.4.2_3.0_1724446061689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_adv_md5_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_adv_md5_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_md5_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_md5_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_en.md new file mode 100644 index 00000000000000..042cba0ddd776c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_instruction_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_2_en_5.4.2_3.0_1724447325185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_2_en_5.4.2_3.0_1724447325185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..fe4cd202a8dec3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_instruction_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_2_pipeline_en_5.4.2_3.0_1724447472277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_2_pipeline_en_5.4.2_3.0_1724447472277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_en.md new file mode 100644 index 00000000000000..c54530372f840c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_own_adv_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_own_adv_instruction_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_own_adv_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_own_adv_instruction_1_en_5.4.2_3.0_1724453943799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_own_adv_instruction_1_en_5.4.2_3.0_1724453943799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_own_adv_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_own_adv_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_own_adv_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_own_adv_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..739b9892a3655a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_own_adv_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_own_adv_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_own_adv_instruction_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_own_adv_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_own_adv_instruction_1_pipeline_en_5.4.2_3.0_1724454095786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_own_adv_instruction_1_pipeline_en_5.4.2_3.0_1724454095786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_own_adv_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_own_adv_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_own_adv_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_own_adv_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_en.md b/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_en.md new file mode 100644 index 00000000000000..601fa5768c9246 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_t5_large_iirc_gold T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_t5_large_iirc_gold +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_t5_large_iirc_gold` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_t5_large_iirc_gold_en_5.4.2_3.0_1724444860364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_t5_large_iirc_gold_en_5.4.2_3.0_1724444860364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_t5_large_iirc_gold","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_t5_large_iirc_gold", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_t5_large_iirc_gold| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-t5-large-iirc-gold \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_pipeline_en.md new file mode 100644 index 00000000000000..a1277fef333c26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-teabreac_t5_large_iirc_gold_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_t5_large_iirc_gold_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_t5_large_iirc_gold_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_t5_large_iirc_gold_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_t5_large_iirc_gold_pipeline_en_5.4.2_3.0_1724445004857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_t5_large_iirc_gold_pipeline_en_5.4.2_3.0_1724445004857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_t5_large_iirc_gold_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_t5_large_iirc_gold_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_t5_large_iirc_gold_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-t5-large-iirc-gold + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_en.md new file mode 100644 index 00000000000000..7f4b89c3c32e90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v72 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v72 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v72` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v72_en_5.4.2_3.0_1724455904215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v72_en_5.4.2_3.0_1724455904215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v72","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v72", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v72| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v72 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_pipeline_en.md new file mode 100644 index 00000000000000..3b06b49e51a6c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v72_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v72_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v72_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v72_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v72_pipeline_en_5.4.2_3.0_1724455921160.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v72_pipeline_en_5.4.2_3.0_1724455921160.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v72_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v72_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v72_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v72 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_en.md new file mode 100644 index 00000000000000..4124baa062cd41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v8 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v8` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v8_en_5.4.2_3.0_1724414793187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v8_en_5.4.2_3.0_1724414793187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_pipeline_en.md new file mode 100644 index 00000000000000..b73ff2f74e80c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v8_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v8_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v8_pipeline_en_5.4.2_3.0_1724414853539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v8_pipeline_en_5.4.2_3.0_1724414853539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_en.md new file mode 100644 index 00000000000000..e0078cb676e00a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English thaisum_v3 T5Transformer from petchbks01 +author: John Snow Labs +name: thaisum_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`thaisum_v3` is a English model originally trained by petchbks01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/thaisum_v3_en_5.4.2_3.0_1724454272426.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/thaisum_v3_en_5.4.2_3.0_1724454272426.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("thaisum_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("thaisum_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|thaisum_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.7 MB| + +## References + +https://huggingface.co/petchbks01/thaisum_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_pipeline_en.md new file mode 100644 index 00000000000000..855797819a5393 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-thaisum_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English thaisum_v3_pipeline pipeline T5Transformer from petchbks01 +author: John Snow Labs +name: thaisum_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`thaisum_v3_pipeline` is a English model originally trained by petchbks01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/thaisum_v3_pipeline_en_5.4.2_3.0_1724454292310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/thaisum_v3_pipeline_en_5.4.2_3.0_1724454292310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("thaisum_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("thaisum_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|thaisum_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.7 MB| + +## References + +https://huggingface.co/petchbks01/thaisum_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_en.md b/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_en.md new file mode 100644 index 00000000000000..101dfa4034b05a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English totto_t5_base_bleurt_24k_steps T5Transformer from Tejas21 +author: John Snow Labs +name: totto_t5_base_bleurt_24k_steps +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`totto_t5_base_bleurt_24k_steps` is a English model originally trained by Tejas21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/totto_t5_base_bleurt_24k_steps_en_5.4.2_3.0_1724417698119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/totto_t5_base_bleurt_24k_steps_en_5.4.2_3.0_1724417698119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("totto_t5_base_bleurt_24k_steps","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("totto_t5_base_bleurt_24k_steps", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|totto_t5_base_bleurt_24k_steps| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tejas21/Totto_t5_base_BLEURT_24k_steps \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_pipeline_en.md new file mode 100644 index 00000000000000..e1eaaef961853d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-totto_t5_base_bleurt_24k_steps_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English totto_t5_base_bleurt_24k_steps_pipeline pipeline T5Transformer from Tejas21 +author: John Snow Labs +name: totto_t5_base_bleurt_24k_steps_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`totto_t5_base_bleurt_24k_steps_pipeline` is a English model originally trained by Tejas21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/totto_t5_base_bleurt_24k_steps_pipeline_en_5.4.2_3.0_1724417747864.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/totto_t5_base_bleurt_24k_steps_pipeline_en_5.4.2_3.0_1724417747864.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("totto_t5_base_bleurt_24k_steps_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("totto_t5_base_bleurt_24k_steps_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|totto_t5_base_bleurt_24k_steps_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tejas21/Totto_t5_base_BLEURT_24k_steps + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-toxification_en.md b/docs/_posts/ahmedlone127/2024-08-23-toxification_en.md new file mode 100644 index 00000000000000..5a984ea6568d2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-toxification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English toxification T5Transformer from MegaKosT +author: John Snow Labs +name: toxification +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toxification` is a English model originally trained by MegaKosT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toxification_en_5.4.2_3.0_1724434767091.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toxification_en_5.4.2_3.0_1724434767091.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("toxification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("toxification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toxification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/MegaKosT/toxification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-toxification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-toxification_pipeline_en.md new file mode 100644 index 00000000000000..507b528d41c7c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-toxification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English toxification_pipeline pipeline T5Transformer from MegaKosT +author: John Snow Labs +name: toxification_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toxification_pipeline` is a English model originally trained by MegaKosT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toxification_pipeline_en_5.4.2_3.0_1724434812415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toxification_pipeline_en_5.4.2_3.0_1724434812415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("toxification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("toxification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toxification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/MegaKosT/toxification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-translation_italian_en.md b/docs/_posts/ahmedlone127/2024-08-23-translation_italian_en.md new file mode 100644 index 00000000000000..f3aaa342620eac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-translation_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translation_italian T5Transformer from homersimpson +author: John Snow Labs +name: translation_italian +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_italian` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_italian_en_5.4.2_3.0_1724415947856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_italian_en_5.4.2_3.0_1724415947856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/homersimpson/translation-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-translation_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-translation_italian_pipeline_en.md new file mode 100644 index 00000000000000..5aa0397f322a3e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-translation_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translation_italian_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: translation_italian_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_italian_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_italian_pipeline_en_5.4.2_3.0_1724415997444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_italian_pipeline_en_5.4.2_3.0_1724415997444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/homersimpson/translation-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-turkmen_instruct_squad_large_5_en.md b/docs/_posts/ahmedlone127/2024-08-23-turkmen_instruct_squad_large_5_en.md new file mode 100644 index 00000000000000..b8bc8cc4add441 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-turkmen_instruct_squad_large_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_large_5 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_large_5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_large_5` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_large_5_en_5.4.2_3.0_1724440601720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_large_5_en_5.4.2_3.0_1724440601720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_large_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_large_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_large_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-large-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_fi.md b/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_fi.md new file mode 100644 index 00000000000000..adae9a63489846 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_fi.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Finnish ul2_tiny_nl6_finnish T5Transformer from Finnish-NLP +author: John Snow Labs +name: ul2_tiny_nl6_finnish +date: 2024-08-23 +tags: [fi, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fi +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_tiny_nl6_finnish` is a Finnish model originally trained by Finnish-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_tiny_nl6_finnish_fi_5.4.2_3.0_1724422653423.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_tiny_nl6_finnish_fi_5.4.2_3.0_1724422653423.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ul2_tiny_nl6_finnish","fi") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ul2_tiny_nl6_finnish", "fi") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_tiny_nl6_finnish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fi| +|Size:|145.7 MB| + +## References + +https://huggingface.co/Finnish-NLP/ul2-tiny-nl6-finnish \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_pipeline_fi.md b/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_pipeline_fi.md new file mode 100644 index 00000000000000..d34be9fdf21fd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ul2_tiny_nl6_finnish_pipeline_fi.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Finnish ul2_tiny_nl6_finnish_pipeline pipeline T5Transformer from Finnish-NLP +author: John Snow Labs +name: ul2_tiny_nl6_finnish_pipeline +date: 2024-08-23 +tags: [fi, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fi +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_tiny_nl6_finnish_pipeline` is a Finnish model originally trained by Finnish-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_tiny_nl6_finnish_pipeline_fi_5.4.2_3.0_1724422661556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_tiny_nl6_finnish_pipeline_fi_5.4.2_3.0_1724422661556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ul2_tiny_nl6_finnish_pipeline", lang = "fi") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ul2_tiny_nl6_finnish_pipeline", lang = "fi") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_tiny_nl6_finnish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fi| +|Size:|145.7 MB| + +## References + +https://huggingface.co/Finnish-NLP/ul2-tiny-nl6-finnish + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_en.md b/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_en.md new file mode 100644 index 00000000000000..6da3bfa5688ebb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English unaniflant5 T5Transformer from HaiderSultanArc +author: John Snow Labs +name: unaniflant5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unaniflant5` is a English model originally trained by HaiderSultanArc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unaniflant5_en_5.4.2_3.0_1724407729799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unaniflant5_en_5.4.2_3.0_1724407729799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("unaniflant5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("unaniflant5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unaniflant5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/HaiderSultanArc/UnaniFlanT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_pipeline_en.md new file mode 100644 index 00000000000000..300d1f978620c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-unaniflant5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English unaniflant5_pipeline pipeline T5Transformer from HaiderSultanArc +author: John Snow Labs +name: unaniflant5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unaniflant5_pipeline` is a English model originally trained by HaiderSultanArc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unaniflant5_pipeline_en_5.4.2_3.0_1724407746624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unaniflant5_pipeline_en_5.4.2_3.0_1724407746624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("unaniflant5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("unaniflant5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unaniflant5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/HaiderSultanArc/UnaniFlanT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_en.md b/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_en.md new file mode 100644 index 00000000000000..157819f744a2d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English viachat_t5_large_v0_95 T5Transformer from towing +author: John Snow Labs +name: viachat_t5_large_v0_95 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`viachat_t5_large_v0_95` is a English model originally trained by towing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/viachat_t5_large_v0_95_en_5.4.2_3.0_1724436257538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/viachat_t5_large_v0_95_en_5.4.2_3.0_1724436257538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("viachat_t5_large_v0_95","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("viachat_t5_large_v0_95", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|viachat_t5_large_v0_95| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/towing/viachat-t5-large-v0.95 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_pipeline_en.md new file mode 100644 index 00000000000000..68a37d290e568c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-viachat_t5_large_v0_95_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English viachat_t5_large_v0_95_pipeline pipeline T5Transformer from towing +author: John Snow Labs +name: viachat_t5_large_v0_95_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`viachat_t5_large_v0_95_pipeline` is a English model originally trained by towing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/viachat_t5_large_v0_95_pipeline_en_5.4.2_3.0_1724436399375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/viachat_t5_large_v0_95_pipeline_en_5.4.2_3.0_1724436399375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("viachat_t5_large_v0_95_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("viachat_t5_large_v0_95_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|viachat_t5_large_v0_95_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/towing/viachat-t5-large-v0.95 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_en.md new file mode 100644 index 00000000000000..606dbb02873048 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_finetuned_ewe_v3 T5Transformer from toan-it-mta +author: John Snow Labs +name: vit5_finetuned_ewe_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_finetuned_ewe_v3` is a English model originally trained by toan-it-mta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_finetuned_ewe_v3_en_5.4.2_3.0_1724414557468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_finetuned_ewe_v3_en_5.4.2_3.0_1724414557468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_finetuned_ewe_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_finetuned_ewe_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_finetuned_ewe_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/toan-it-mta/vit5-finetuned-ee-v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_pipeline_en.md new file mode 100644 index 00000000000000..d4b04b569aef00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-vit5_finetuned_ewe_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_finetuned_ewe_v3_pipeline pipeline T5Transformer from toan-it-mta +author: John Snow Labs +name: vit5_finetuned_ewe_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_finetuned_ewe_v3_pipeline` is a English model originally trained by toan-it-mta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_finetuned_ewe_v3_pipeline_en_5.4.2_3.0_1724414607119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_finetuned_ewe_v3_pipeline_en_5.4.2_3.0_1724414607119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_finetuned_ewe_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_finetuned_ewe_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_finetuned_ewe_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/toan-it-mta/vit5-finetuned-ee-v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-20231130_6_en.md b/docs/_posts/ahmedlone127/2024-08-24-20231130_6_en.md new file mode 100644 index 00000000000000..e1674e1bc6e46a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-20231130_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20231130_6 T5Transformer from picas9dan +author: John Snow Labs +name: 20231130_6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_6` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_6_en_5.4.2_3.0_1724505338771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_6_en_5.4.2_3.0_1724505338771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20231130_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20231130_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20231130_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20231130_6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-20231130_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-20231130_6_pipeline_en.md new file mode 100644 index 00000000000000..908748cb5cf51c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-20231130_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20231130_6_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20231130_6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_6_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_6_pipeline_en_5.4.2_3.0_1724505477429.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_6_pipeline_en_5.4.2_3.0_1724505477429.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20231130_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20231130_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20231130_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20231130_6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-20240116_6_en.md b/docs/_posts/ahmedlone127/2024-08-24-20240116_6_en.md new file mode 100644 index 00000000000000..429828edb9bfee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-20240116_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240116_6 T5Transformer from picas9dan +author: John Snow Labs +name: 20240116_6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_6` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_6_en_5.4.2_3.0_1724524353762.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_6_en_5.4.2_3.0_1724524353762.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240116_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240116_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240116_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240116_6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-20240130_7_en.md b/docs/_posts/ahmedlone127/2024-08-24-20240130_7_en.md new file mode 100644 index 00000000000000..72e95a335ee723 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-20240130_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240130_7 T5Transformer from picas9dan +author: John Snow Labs +name: 20240130_7 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240130_7` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240130_7_en_5.4.2_3.0_1724524186089.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240130_7_en_5.4.2_3.0_1724524186089.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240130_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240130_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240130_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240130_7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-20240130_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-20240130_7_pipeline_en.md new file mode 100644 index 00000000000000..f813bfaed08192 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-20240130_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240130_7_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240130_7_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240130_7_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240130_7_pipeline_en_5.4.2_3.0_1724524417911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240130_7_pipeline_en_5.4.2_3.0_1724524417911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240130_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240130_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240130_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240130_7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_en.md b/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_en.md new file mode 100644 index 00000000000000..200fa224ef41e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya T5Transformer from cornelliusyudhawijaya +author: John Snow Labs +name: abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya` is a English model originally trained by cornelliusyudhawijaya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_en_5.4.2_3.0_1724540190821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_en_5.4.2_3.0_1724540190821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|878.5 MB| + +## References + +https://huggingface.co/cornelliusyudhawijaya/abstracts_to_post_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline_en.md new file mode 100644 index 00000000000000..638fee03aea08b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline pipeline T5Transformer from cornelliusyudhawijaya +author: John Snow Labs +name: abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline` is a English model originally trained by cornelliusyudhawijaya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline_en_5.4.2_3.0_1724540274094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline_en_5.4.2_3.0_1724540274094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|abstracts_tonga_tonga_islands_post_model_cornelliusyudhawijaya_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|878.5 MB| + +## References + +https://huggingface.co/cornelliusyudhawijaya/abstracts_to_post_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_en.md b/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_en.md new file mode 100644 index 00000000000000..cabb7155c51843 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English active_tonga_tonga_islands_passive_sanjay_m1 T5Transformer from sanjay-m1 +author: John Snow Labs +name: active_tonga_tonga_islands_passive_sanjay_m1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`active_tonga_tonga_islands_passive_sanjay_m1` is a English model originally trained by sanjay-m1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/active_tonga_tonga_islands_passive_sanjay_m1_en_5.4.2_3.0_1724472100644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/active_tonga_tonga_islands_passive_sanjay_m1_en_5.4.2_3.0_1724472100644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("active_tonga_tonga_islands_passive_sanjay_m1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("active_tonga_tonga_islands_passive_sanjay_m1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|active_tonga_tonga_islands_passive_sanjay_m1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.3 MB| + +## References + +https://huggingface.co/sanjay-m1/active-to-passive \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_pipeline_en.md new file mode 100644 index 00000000000000..4a4e3b30855037 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-active_tonga_tonga_islands_passive_sanjay_m1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English active_tonga_tonga_islands_passive_sanjay_m1_pipeline pipeline T5Transformer from sanjay-m1 +author: John Snow Labs +name: active_tonga_tonga_islands_passive_sanjay_m1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`active_tonga_tonga_islands_passive_sanjay_m1_pipeline` is a English model originally trained by sanjay-m1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/active_tonga_tonga_islands_passive_sanjay_m1_pipeline_en_5.4.2_3.0_1724472120737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/active_tonga_tonga_islands_passive_sanjay_m1_pipeline_en_5.4.2_3.0_1724472120737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("active_tonga_tonga_islands_passive_sanjay_m1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("active_tonga_tonga_islands_passive_sanjay_m1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|active_tonga_tonga_islands_passive_sanjay_m1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.3 MB| + +## References + +https://huggingface.co/sanjay-m1/active-to-passive + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ada_t5_small_scir_hi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-ada_t5_small_scir_hi_pipeline_en.md new file mode 100644 index 00000000000000..7190db4666eab5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ada_t5_small_scir_hi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ada_t5_small_scir_hi_pipeline pipeline T5Transformer from SCIR-HI +author: John Snow Labs +name: ada_t5_small_scir_hi_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ada_t5_small_scir_hi_pipeline` is a English model originally trained by SCIR-HI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ada_t5_small_scir_hi_pipeline_en_5.4.2_3.0_1724533867235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ada_t5_small_scir_hi_pipeline_en_5.4.2_3.0_1724533867235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ada_t5_small_scir_hi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ada_t5_small_scir_hi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ada_t5_small_scir_hi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|310.6 MB| + +## References + +https://huggingface.co/SCIR-HI/ada-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-albert_base_qa_squad2_en.md b/docs/_posts/ahmedlone127/2024-08-24-albert_base_qa_squad2_en.md new file mode 100644 index 00000000000000..fd210d32cb76b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-albert_base_qa_squad2_en.md @@ -0,0 +1,89 @@ +--- +layout: model +title: English AlbertForQuestionAnswering model (from twmkn9) +author: John Snow Labs +name: albert_base_qa_squad2 +date: 2024-08-24 +tags: [question_answering, albert, openvino, en, open_source] +task: Question Answering +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: openvino +annotator: AlbertForQuestionAnswering +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +“ +Pretrained Question Answering model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. albert-base-v2-squad2 is a English model originally trained by twmkn9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/albert_base_qa_squad2_en_5.4.2_3.0_1724505373831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/albert_base_qa_squad2_en_5.4.2_3.0_1724505373831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = MultiDocumentAssembler() \ +.setInputCols(["question", "context"]) \ +.setOutputCols(["document_question", "document_context"]) + +spanClassifier = AlbertForQuestionAnswering.pretrained("albert_base_qa_squad2","en") \ +.setInputCols(["document_question", "document_context"]) \ +.setOutputCol("answer").setCaseSensitive(True) + +pipeline = Pipeline(stages=[documentAssembler, spanClassifier]) + +data = spark.createDataFrame([["What is my name?", "My name is Clara and I live in Berkeley."]]).toDF("question", "context") + +result = pipeline.fit(data).transform(data) + +``` +```scala + +val documentAssembler = new MultiDocumentAssembler() +.setInputCols(Array("question", "context")) +.setOutputCols(Array("document_question", "document_context")) + +val spanClassifer = AlbertForQuestionAnswering.pretrained("albert_base_qa_squad2","en") +.setInputCols(Array("document", "token")) +.setOutputCol("answer") +.setCaseSensitive(true) + +val pipeline = new Pipeline().setStages(Array(documentAssembler, spanClassifier)) + +val data = Seq("What is my name?", "My name is Clara and I live in Berkeley.").toDF("question", "context") + +val result = pipeline.fit(data).transform(data) + + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|albert_base_qa_squad2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document_question, document_context]| +|Output Labels:|[answer]| +|Language:|en| +|Size:|42.0 MB| +|Case sensitive:|false| +|Max sentence length:|512| \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-albert_base_toxicity_en.md b/docs/_posts/ahmedlone127/2024-08-24-albert_base_toxicity_en.md new file mode 100644 index 00000000000000..05f47e15a32f2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-albert_base_toxicity_en.md @@ -0,0 +1,98 @@ +--- +layout: model +title: ALBERT Sequence Classification Base - Toxicity (albert_base_toxicity) +author: John Snow Labs +name: albert_base_toxicity +date: 2024-08-24 +tags: [sequence_classification, albert, openvino, en, open_source] +task: Text Classification +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: openvino +annotator: AlbertForSequenceClassification +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +“ + + ALBERT Model with sequence classification/regression head on top (a linear layer on top of the pooled output) e.g. for multi-class document classification tasks. + +albert_base_sequence_classifier_imdb is a fine-tuned ALBERT model that is ready to be used for Sequence Classification tasks such as sentiment analysis or multi-class text classification and it achieves state-of-the-art performance. + +We used TFAlbertForSequenceClassification to train this model and used AlbertForSequenceClassification annotator in Spark NLP 🚀 for prediction at scale! + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/albert_base_toxicity_en_5.4.2_3.0_1724533542430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/albert_base_toxicity_en_5.4.2_3.0_1724533542430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +document_assembler = DocumentAssembler() .setInputCol('text') .setOutputCol('document') + +tokenizer = Tokenizer() .setInputCols(['document']) .setOutputCol('token') + +sequenceClassifier = AlbertForSequenceClassification .pretrained('albert_base_toxicity', 'en') .setInputCols(['token', 'document']) .setOutputCol('class') .setCaseSensitive(False) .setMaxSentenceLength(512) + +pipeline = Pipeline(stages=[ +document_assembler, +tokenizer, +sequenceClassifier +]) + +example = spark.createDataFrame([['I really liked that movie!']]).toDF("text") +result = pipeline.fit(example).transform(example) + +``` +```scala + +val document_assembler = DocumentAssembler() +.setInputCol("text") +.setOutputCol("document") + +val tokenizer = Tokenizer() +.setInputCols("document") +.setOutputCol("token") + +val tokenClassifier = AlbertForSequenceClassification.pretrained("albert_base_toxicity", "en") +.setInputCols("document", "token") +.setOutputCol("class") +.setCaseSensitive(false) +.setMaxSentenceLength(512) + +val pipeline = new Pipeline().setStages(Array(document_assembler, tokenizer, sequenceClassifier)) + +val example = Seq("I really liked that movie!").toDS.toDF("text") + +val result = pipeline.fit(example).transform(example) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|albert_base_toxicity| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[token, document]| +|Output Labels:|[label]| +|Language:|en| +|Size:|44.2 MB| +|Case sensitive:|true| \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_en.md b/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_en.md new file mode 100644 index 00000000000000..052362975e51b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_base_qg_mlq_arabic T5Transformer from sidovic +author: John Snow Labs +name: arat5_base_qg_mlq_arabic +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_base_qg_mlq_arabic` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_base_qg_mlq_arabic_en_5.4.2_3.0_1724514931152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_base_qg_mlq_arabic_en_5.4.2_3.0_1724514931152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_base_qg_mlq_arabic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_base_qg_mlq_arabic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_base_qg_mlq_arabic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/sidovic/AraT5-base-qg-mlq_arabic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_pipeline_en.md new file mode 100644 index 00000000000000..ce65c06da6c244 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-arat5_base_qg_mlq_arabic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_base_qg_mlq_arabic_pipeline pipeline T5Transformer from sidovic +author: John Snow Labs +name: arat5_base_qg_mlq_arabic_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_base_qg_mlq_arabic_pipeline` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_base_qg_mlq_arabic_pipeline_en_5.4.2_3.0_1724515010908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_base_qg_mlq_arabic_pipeline_en_5.4.2_3.0_1724515010908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_base_qg_mlq_arabic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_base_qg_mlq_arabic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_base_qg_mlq_arabic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/sidovic/AraT5-base-qg-mlq_arabic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_en.md b/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_en.md new file mode 100644 index 00000000000000..db900d91132307 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_translatedwikisqlnltosql T5Transformer from obada-jaras +author: John Snow Labs +name: arat5_translatedwikisqlnltosql +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_translatedwikisqlnltosql` is a English model originally trained by obada-jaras. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_translatedwikisqlnltosql_en_5.4.2_3.0_1724497707155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_translatedwikisqlnltosql_en_5.4.2_3.0_1724497707155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_translatedwikisqlnltosql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_translatedwikisqlnltosql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_translatedwikisqlnltosql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/obada-jaras/AraT5-TranslatedWikiSQLNLtoSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_pipeline_en.md new file mode 100644 index 00000000000000..d0469537d1475e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-arat5_translatedwikisqlnltosql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_translatedwikisqlnltosql_pipeline pipeline T5Transformer from obada-jaras +author: John Snow Labs +name: arat5_translatedwikisqlnltosql_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_translatedwikisqlnltosql_pipeline` is a English model originally trained by obada-jaras. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_translatedwikisqlnltosql_pipeline_en_5.4.2_3.0_1724497799441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_translatedwikisqlnltosql_pipeline_en_5.4.2_3.0_1724497799441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_translatedwikisqlnltosql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_translatedwikisqlnltosql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_translatedwikisqlnltosql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/obada-jaras/AraT5-TranslatedWikiSQLNLtoSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_en.md b/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_en.md new file mode 100644 index 00000000000000..eeb4a7a3ec8be2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English articletotitlet5 T5Transformer from SuperNova672 +author: John Snow Labs +name: articletotitlet5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`articletotitlet5` is a English model originally trained by SuperNova672. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/articletotitlet5_en_5.4.2_3.0_1724488483512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/articletotitlet5_en_5.4.2_3.0_1724488483512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("articletotitlet5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("articletotitlet5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|articletotitlet5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|995.8 MB| + +## References + +https://huggingface.co/SuperNova672/ArticleToTitleT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_pipeline_en.md new file mode 100644 index 00000000000000..f87865f6036ef3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-articletotitlet5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English articletotitlet5_pipeline pipeline T5Transformer from SuperNova672 +author: John Snow Labs +name: articletotitlet5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`articletotitlet5_pipeline` is a English model originally trained by SuperNova672. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/articletotitlet5_pipeline_en_5.4.2_3.0_1724488532011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/articletotitlet5_pipeline_en_5.4.2_3.0_1724488532011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("articletotitlet5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("articletotitlet5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|articletotitlet5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|995.8 MB| + +## References + +https://huggingface.co/SuperNova672/ArticleToTitleT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md b/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md new file mode 100644 index 00000000000000..429baf6558f57d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants T5Transformer from kevinscaria +author: John Snow Labs +name: atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_en_5.4.2_3.0_1724506687814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_en_5.4.2_3.0_1724506687814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|937.7 MB| + +## References + +https://huggingface.co/kevinscaria/atsc_tk-instruct-base-def-pos-restaurants \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md new file mode 100644 index 00000000000000..216830b72451fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en_5.4.2_3.0_1724506738785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en_5.4.2_3.0_1724506738785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|atsc_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|937.7 MB| + +## References + +https://huggingface.co/kevinscaria/atsc_tk-instruct-base-def-pos-restaurants + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_en.md b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_en.md new file mode 100644 index 00000000000000..267d145ad67cad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autonlp_us_tonga_tonga_islands_aus_607117159 T5Transformer from spy24 +author: John Snow Labs +name: autonlp_us_tonga_tonga_islands_aus_607117159 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_us_tonga_tonga_islands_aus_607117159` is a English model originally trained by spy24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_aus_607117159_en_5.4.2_3.0_1724468368024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_aus_607117159_en_5.4.2_3.0_1724468368024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autonlp_us_tonga_tonga_islands_aus_607117159","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autonlp_us_tonga_tonga_islands_aus_607117159", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_us_tonga_tonga_islands_aus_607117159| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/spy24/autonlp-US_to_AUS-607117159 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_pipeline_en.md new file mode 100644 index 00000000000000..472e25297a85e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_aus_607117159_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autonlp_us_tonga_tonga_islands_aus_607117159_pipeline pipeline T5Transformer from spy24 +author: John Snow Labs +name: autonlp_us_tonga_tonga_islands_aus_607117159_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_us_tonga_tonga_islands_aus_607117159_pipeline` is a English model originally trained by spy24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_aus_607117159_pipeline_en_5.4.2_3.0_1724468418136.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_aus_607117159_pipeline_en_5.4.2_3.0_1724468418136.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autonlp_us_tonga_tonga_islands_aus_607117159_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autonlp_us_tonga_tonga_islands_aus_607117159_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_us_tonga_tonga_islands_aus_607117159_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/spy24/autonlp-US_to_AUS-607117159 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_en.md b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_en.md new file mode 100644 index 00000000000000..d44c3ede5e34bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autonlp_us_tonga_tonga_islands_ukrainian_604417040 T5Transformer from spy24 +author: John Snow Labs +name: autonlp_us_tonga_tonga_islands_ukrainian_604417040 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_us_tonga_tonga_islands_ukrainian_604417040` is a English model originally trained by spy24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_ukrainian_604417040_en_5.4.2_3.0_1724468080164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_ukrainian_604417040_en_5.4.2_3.0_1724468080164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autonlp_us_tonga_tonga_islands_ukrainian_604417040","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autonlp_us_tonga_tonga_islands_ukrainian_604417040", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_us_tonga_tonga_islands_ukrainian_604417040| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/spy24/autonlp-US-to-UK-604417040 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline_en.md new file mode 100644 index 00000000000000..26b146df8c9f70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline pipeline T5Transformer from spy24 +author: John Snow Labs +name: autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline` is a English model originally trained by spy24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline_en_5.4.2_3.0_1724468127855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline_en_5.4.2_3.0_1724468127855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_us_tonga_tonga_islands_ukrainian_604417040_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/spy24/autonlp-US-to-UK-604417040 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_en.md b/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_en.md new file mode 100644 index 00000000000000..bebb43f93aa247 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English balanced_genai_training T5Transformer from ahsan-mavros +author: John Snow Labs +name: balanced_genai_training +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`balanced_genai_training` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/balanced_genai_training_en_5.4.2_3.0_1724470709708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/balanced_genai_training_en_5.4.2_3.0_1724470709708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("balanced_genai_training","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("balanced_genai_training", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|balanced_genai_training| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/balanced-genai-training \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_pipeline_en.md new file mode 100644 index 00000000000000..b2f2910b9a5307 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-balanced_genai_training_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English balanced_genai_training_pipeline pipeline T5Transformer from ahsan-mavros +author: John Snow Labs +name: balanced_genai_training_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`balanced_genai_training_pipeline` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/balanced_genai_training_pipeline_en_5.4.2_3.0_1724470758708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/balanced_genai_training_pipeline_en_5.4.2_3.0_1724470758708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("balanced_genai_training_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("balanced_genai_training_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|balanced_genai_training_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/balanced-genai-training + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_en.md b/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_en.md new file mode 100644 index 00000000000000..86bb023e44e525 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_30000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_30000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_30000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_30000_en_5.4.2_3.0_1724466363616.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_30000_en_5.4.2_3.0_1724466363616.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_pipeline_en.md new file mode 100644 index 00000000000000..ba78e9a067dcd6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bangla_para_v3_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_30000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_30000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_30000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_30000_pipeline_en_5.4.2_3.0_1724466411843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_30000_pipeline_en_5.4.2_3.0_1724466411843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_en.md new file mode 100644 index 00000000000000..20e331967a6d2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5_banglaparaphrase_finetuned T5Transformer from tanzirghumay +author: John Snow Labs +name: banglat5_banglaparaphrase_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_banglaparaphrase_finetuned` is a English model originally trained by tanzirghumay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_en_5.4.2_3.0_1724509157714.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_en_5.4.2_3.0_1724509157714.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5_banglaparaphrase_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5_banglaparaphrase_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_banglaparaphrase_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tanzirghumay/banglat5_banglaparaphrase-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..f52a5bee7aaba8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-banglat5_banglaparaphrase_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5_banglaparaphrase_finetuned_pipeline pipeline T5Transformer from tanzirghumay +author: John Snow Labs +name: banglat5_banglaparaphrase_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_banglaparaphrase_finetuned_pipeline` is a English model originally trained by tanzirghumay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_pipeline_en_5.4.2_3.0_1724509160299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_pipeline_en_5.4.2_3.0_1724509160299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5_banglaparaphrase_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5_banglaparaphrase_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_banglaparaphrase_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tanzirghumay/banglat5_banglaparaphrase-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_en.md b/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_en.md new file mode 100644 index 00000000000000..59ffd21e0e673f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bart_samsum_finetuning T5Transformer from ahmed13377 +author: John Snow Labs +name: bart_samsum_finetuning +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bart_samsum_finetuning` is a English model originally trained by ahmed13377. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bart_samsum_finetuning_en_5.4.2_3.0_1724485275036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bart_samsum_finetuning_en_5.4.2_3.0_1724485275036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bart_samsum_finetuning","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bart_samsum_finetuning", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bart_samsum_finetuning| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.1 MB| + +## References + +https://huggingface.co/ahmed13377/bart-samsum-finetuning \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_pipeline_en.md new file mode 100644 index 00000000000000..a09d12fdf5477d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bart_samsum_finetuning_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bart_samsum_finetuning_pipeline pipeline T5Transformer from ahmed13377 +author: John Snow Labs +name: bart_samsum_finetuning_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bart_samsum_finetuning_pipeline` is a English model originally trained by ahmed13377. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bart_samsum_finetuning_pipeline_en_5.4.2_3.0_1724485301604.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bart_samsum_finetuning_pipeline_en_5.4.2_3.0_1724485301604.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bart_samsum_finetuning_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bart_samsum_finetuning_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bart_samsum_finetuning_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.1 MB| + +## References + +https://huggingface.co/ahmed13377/bart-samsum-finetuning + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_en.md new file mode 100644 index 00000000000000..1f1132ee976789 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bash_coder_flan_t5_base T5Transformer from rvv-karma +author: John Snow Labs +name: bash_coder_flan_t5_base +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bash_coder_flan_t5_base` is a English model originally trained by rvv-karma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bash_coder_flan_t5_base_en_5.4.2_3.0_1724477627726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bash_coder_flan_t5_base_en_5.4.2_3.0_1724477627726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bash_coder_flan_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bash_coder_flan_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bash_coder_flan_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rvv-karma/BASH-Coder-Flan-T5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..ba93c3c2154598 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bash_coder_flan_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bash_coder_flan_t5_base_pipeline pipeline T5Transformer from rvv-karma +author: John Snow Labs +name: bash_coder_flan_t5_base_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bash_coder_flan_t5_base_pipeline` is a English model originally trained by rvv-karma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bash_coder_flan_t5_base_pipeline_en_5.4.2_3.0_1724477686166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bash_coder_flan_t5_base_pipeline_en_5.4.2_3.0_1724477686166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bash_coder_flan_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bash_coder_flan_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bash_coder_flan_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rvv-karma/BASH-Coder-Flan-T5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_en.md b/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_en.md new file mode 100644 index 00000000000000..daf458a6a1ea0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bdp_summarization_t3 T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t3` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t3_en_5.4.2_3.0_1724537843723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t3_en_5.4.2_3.0_1724537843723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bdp_summarization_t3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bdp_summarization_t3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_pipeline_en.md new file mode 100644 index 00000000000000..86a45a60fbf48a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bdp_summarization_t3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bdp_summarization_t3_pipeline pipeline T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t3_pipeline` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t3_pipeline_en_5.4.2_3.0_1724537860981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t3_pipeline_en_5.4.2_3.0_1724537860981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bdp_summarization_t3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bdp_summarization_t3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_en.md b/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_en.md new file mode 100644 index 00000000000000..3d6dd3cf0337a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bhc_baseline_t5_test T5Transformer from RyanZZZZZ +author: John Snow Labs +name: bhc_baseline_t5_test +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bhc_baseline_t5_test` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bhc_baseline_t5_test_en_5.4.2_3.0_1724515857214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bhc_baseline_t5_test_en_5.4.2_3.0_1724515857214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bhc_baseline_t5_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bhc_baseline_t5_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bhc_baseline_t5_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/RyanZZZZZ/bhc_baseline_t5_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_pipeline_en.md new file mode 100644 index 00000000000000..e288b12a9c2f66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bhc_baseline_t5_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bhc_baseline_t5_test_pipeline pipeline T5Transformer from RyanZZZZZ +author: John Snow Labs +name: bhc_baseline_t5_test_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bhc_baseline_t5_test_pipeline` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bhc_baseline_t5_test_pipeline_en_5.4.2_3.0_1724515876103.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bhc_baseline_t5_test_pipeline_en_5.4.2_3.0_1724515876103.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bhc_baseline_t5_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bhc_baseline_t5_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bhc_baseline_t5_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/RyanZZZZZ/bhc_baseline_t5_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_en.md b/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_en.md new file mode 100644 index 00000000000000..659d8a764d8679 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bikes_int_t5_small_23 T5Transformer from neal61 +author: John Snow Labs +name: bikes_int_t5_small_23 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_int_t5_small_23` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_int_t5_small_23_en_5.4.2_3.0_1724526917153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_int_t5_small_23_en_5.4.2_3.0_1724526917153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bikes_int_t5_small_23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bikes_int_t5_small_23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_int_t5_small_23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.1 MB| + +## References + +https://huggingface.co/neal61/bikes-int-t5-small-23 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_pipeline_en.md new file mode 100644 index 00000000000000..f7e063af87ba1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bikes_int_t5_small_23_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bikes_int_t5_small_23_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: bikes_int_t5_small_23_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_int_t5_small_23_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_int_t5_small_23_pipeline_en_5.4.2_3.0_1724526934230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_int_t5_small_23_pipeline_en_5.4.2_3.0_1724526934230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bikes_int_t5_small_23_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bikes_int_t5_small_23_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_int_t5_small_23_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.1 MB| + +## References + +https://huggingface.co/neal61/bikes-int-t5-small-23 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_en.md new file mode 100644 index 00000000000000..b55d3fc3bd4b04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bnpunct_banglat5_seq2seq_finetuned T5Transformer from samanjoy2 +author: John Snow Labs +name: bnpunct_banglat5_seq2seq_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bnpunct_banglat5_seq2seq_finetuned` is a English model originally trained by samanjoy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bnpunct_banglat5_seq2seq_finetuned_en_5.4.2_3.0_1724476585998.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bnpunct_banglat5_seq2seq_finetuned_en_5.4.2_3.0_1724476585998.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bnpunct_banglat5_seq2seq_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bnpunct_banglat5_seq2seq_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bnpunct_banglat5_seq2seq_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/samanjoy2/bnpunct_banglat5_seq2seq_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..66013aecd78b75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-bnpunct_banglat5_seq2seq_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bnpunct_banglat5_seq2seq_finetuned_pipeline pipeline T5Transformer from samanjoy2 +author: John Snow Labs +name: bnpunct_banglat5_seq2seq_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bnpunct_banglat5_seq2seq_finetuned_pipeline` is a English model originally trained by samanjoy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bnpunct_banglat5_seq2seq_finetuned_pipeline_en_5.4.2_3.0_1724476638359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bnpunct_banglat5_seq2seq_finetuned_pipeline_en_5.4.2_3.0_1724476638359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bnpunct_banglat5_seq2seq_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bnpunct_banglat5_seq2seq_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bnpunct_banglat5_seq2seq_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/samanjoy2/bnpunct_banglat5_seq2seq_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-book_data_en.md b/docs/_posts/ahmedlone127/2024-08-24-book_data_en.md new file mode 100644 index 00000000000000..82d2f49a28aded --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-book_data_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English book_data T5Transformer from mimi +author: John Snow Labs +name: book_data +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`book_data` is a English model originally trained by mimi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/book_data_en_5.4.2_3.0_1724522291126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/book_data_en_5.4.2_3.0_1724522291126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("book_data","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("book_data", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|book_data| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mimi/book_data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-book_data_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-book_data_pipeline_en.md new file mode 100644 index 00000000000000..2e44527bd51dfd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-book_data_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English book_data_pipeline pipeline T5Transformer from mimi +author: John Snow Labs +name: book_data_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`book_data_pipeline` is a English model originally trained by mimi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/book_data_pipeline_en_5.4.2_3.0_1724522348025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/book_data_pipeline_en_5.4.2_3.0_1724522348025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("book_data_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("book_data_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|book_data_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mimi/book_data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_en.md new file mode 100644 index 00000000000000..ce45fcc3abe6d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_abuchotu T5Transformer from abuchotu +author: John Snow Labs +name: burmese_awesome_billsum_model_abuchotu +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_abuchotu` is a English model originally trained by abuchotu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_abuchotu_en_5.4.2_3.0_1724530324617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_abuchotu_en_5.4.2_3.0_1724530324617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_abuchotu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_abuchotu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_abuchotu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.2 MB| + +## References + +https://huggingface.co/abuchotu/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_pipeline_en.md new file mode 100644 index 00000000000000..7ff4364f7ebc49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_abuchotu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_abuchotu_pipeline pipeline T5Transformer from abuchotu +author: John Snow Labs +name: burmese_awesome_billsum_model_abuchotu_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_abuchotu_pipeline` is a English model originally trained by abuchotu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_abuchotu_pipeline_en_5.4.2_3.0_1724530345433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_abuchotu_pipeline_en_5.4.2_3.0_1724530345433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_abuchotu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_abuchotu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_abuchotu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.2 MB| + +## References + +https://huggingface.co/abuchotu/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_en.md new file mode 100644 index 00000000000000..847ded355108e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_meziane T5Transformer from Meziane +author: John Snow Labs +name: burmese_awesome_billsum_model_meziane +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_meziane` is a English model originally trained by Meziane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_meziane_en_5.4.2_3.0_1724506173029.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_meziane_en_5.4.2_3.0_1724506173029.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_meziane","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_meziane", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_meziane| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.6 MB| + +## References + +https://huggingface.co/Meziane/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_pipeline_en.md new file mode 100644 index 00000000000000..a07af411708f03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_billsum_model_meziane_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_meziane_pipeline pipeline T5Transformer from Meziane +author: John Snow Labs +name: burmese_awesome_billsum_model_meziane_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_meziane_pipeline` is a English model originally trained by Meziane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_meziane_pipeline_en_5.4.2_3.0_1724506196303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_meziane_pipeline_en_5.4.2_3.0_1724506196303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_meziane_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_meziane_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_meziane_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.6 MB| + +## References + +https://huggingface.co/Meziane/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_en.md new file mode 100644 index 00000000000000..949d5e4764a47c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_chenzhwsysu57 T5Transformer from chenzhwsysu57 +author: John Snow Labs +name: burmese_awesome_opus_books_model_chenzhwsysu57 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_chenzhwsysu57` is a English model originally trained by chenzhwsysu57. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_chenzhwsysu57_en_5.4.2_3.0_1724494273179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_chenzhwsysu57_en_5.4.2_3.0_1724494273179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_chenzhwsysu57","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_chenzhwsysu57", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_chenzhwsysu57| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/chenzhwsysu57/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_pipeline_en.md new file mode 100644 index 00000000000000..879b99eb3116f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_chenzhwsysu57_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_chenzhwsysu57_pipeline pipeline T5Transformer from chenzhwsysu57 +author: John Snow Labs +name: burmese_awesome_opus_books_model_chenzhwsysu57_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_chenzhwsysu57_pipeline` is a English model originally trained by chenzhwsysu57. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_chenzhwsysu57_pipeline_en_5.4.2_3.0_1724494296219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_chenzhwsysu57_pipeline_en_5.4.2_3.0_1724494296219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_chenzhwsysu57_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_chenzhwsysu57_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_chenzhwsysu57_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/chenzhwsysu57/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_en.md new file mode 100644 index 00000000000000..05d10b61dd180d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_dconte76 T5Transformer from dconte76 +author: John Snow Labs +name: burmese_awesome_opus_books_model_dconte76 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_dconte76` is a English model originally trained by dconte76. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_dconte76_en_5.4.2_3.0_1724479727846.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_dconte76_en_5.4.2_3.0_1724479727846.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_dconte76","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_dconte76", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_dconte76| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/dconte76/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_pipeline_en.md new file mode 100644 index 00000000000000..bf6836d4aa090a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_dconte76_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_dconte76_pipeline pipeline T5Transformer from dconte76 +author: John Snow Labs +name: burmese_awesome_opus_books_model_dconte76_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_dconte76_pipeline` is a English model originally trained by dconte76. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_dconte76_pipeline_en_5.4.2_3.0_1724479745869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_dconte76_pipeline_en_5.4.2_3.0_1724479745869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_dconte76_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_dconte76_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_dconte76_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/dconte76/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_en.md new file mode 100644 index 00000000000000..4412e7286cc885 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_irishzhang T5Transformer from irishzhang +author: John Snow Labs +name: burmese_awesome_opus_books_model_irishzhang +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_irishzhang` is a English model originally trained by irishzhang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irishzhang_en_5.4.2_3.0_1724533898377.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irishzhang_en_5.4.2_3.0_1724533898377.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_irishzhang","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_irishzhang", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_irishzhang| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.4 MB| + +## References + +https://huggingface.co/irishzhang/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_pipeline_en.md new file mode 100644 index 00000000000000..95294bfb51b56f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_irishzhang_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_irishzhang_pipeline pipeline T5Transformer from irishzhang +author: John Snow Labs +name: burmese_awesome_opus_books_model_irishzhang_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_irishzhang_pipeline` is a English model originally trained by irishzhang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irishzhang_pipeline_en_5.4.2_3.0_1724533922260.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irishzhang_pipeline_en_5.4.2_3.0_1724533922260.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_irishzhang_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_irishzhang_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_irishzhang_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.4 MB| + +## References + +https://huggingface.co/irishzhang/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_en.md new file mode 100644 index 00000000000000..cd942dd173a17e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_jhhan T5Transformer from JHhan +author: John Snow Labs +name: burmese_awesome_opus_books_model_jhhan +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_jhhan` is a English model originally trained by JHhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_jhhan_en_5.4.2_3.0_1724494063749.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_jhhan_en_5.4.2_3.0_1724494063749.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_jhhan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_jhhan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_jhhan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/JHhan/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_pipeline_en.md new file mode 100644 index 00000000000000..fc768e58aa38b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_jhhan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_jhhan_pipeline pipeline T5Transformer from JHhan +author: John Snow Labs +name: burmese_awesome_opus_books_model_jhhan_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_jhhan_pipeline` is a English model originally trained by JHhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_jhhan_pipeline_en_5.4.2_3.0_1724494081713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_jhhan_pipeline_en_5.4.2_3.0_1724494081713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_jhhan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_jhhan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_jhhan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/JHhan/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_en.md new file mode 100644 index 00000000000000..44f01df334ebef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mkim_masi T5Transformer from mkim-MASI +author: John Snow Labs +name: burmese_awesome_opus_books_model_mkim_masi +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mkim_masi` is a English model originally trained by mkim-MASI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mkim_masi_en_5.4.2_3.0_1724540864425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mkim_masi_en_5.4.2_3.0_1724540864425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mkim_masi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mkim_masi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mkim_masi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.3 MB| + +## References + +https://huggingface.co/mkim-MASI/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_pipeline_en.md new file mode 100644 index 00000000000000..3c15482b7ab30a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_mkim_masi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mkim_masi_pipeline pipeline T5Transformer from mkim-MASI +author: John Snow Labs +name: burmese_awesome_opus_books_model_mkim_masi_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mkim_masi_pipeline` is a English model originally trained by mkim-MASI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mkim_masi_pipeline_en_5.4.2_3.0_1724540883245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mkim_masi_pipeline_en_5.4.2_3.0_1724540883245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_mkim_masi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_mkim_masi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mkim_masi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.3 MB| + +## References + +https://huggingface.co/mkim-MASI/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_en.md new file mode 100644 index 00000000000000..5de754bf8f00d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_taghiagha T5Transformer from taghiAgha +author: John Snow Labs +name: burmese_awesome_opus_books_model_taghiagha +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_taghiagha` is a English model originally trained by taghiAgha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_taghiagha_en_5.4.2_3.0_1724523040176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_taghiagha_en_5.4.2_3.0_1724523040176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_taghiagha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_taghiagha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_taghiagha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.7 MB| + +## References + +https://huggingface.co/taghiAgha/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_pipeline_en.md new file mode 100644 index 00000000000000..a4f2b62fdd8a73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_model_taghiagha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_taghiagha_pipeline pipeline T5Transformer from taghiAgha +author: John Snow Labs +name: burmese_awesome_opus_books_model_taghiagha_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_taghiagha_pipeline` is a English model originally trained by taghiAgha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_taghiagha_pipeline_en_5.4.2_3.0_1724523057633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_taghiagha_pipeline_en_5.4.2_3.0_1724523057633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_taghiagha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_taghiagha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_taghiagha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.7 MB| + +## References + +https://huggingface.co/taghiAgha/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_en.md new file mode 100644 index 00000000000000..81ee0e7be5b020 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_modelllo_block T5Transformer from wiktorw +author: John Snow Labs +name: burmese_awesome_opus_books_modelllo_block +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_modelllo_block` is a English model originally trained by wiktorw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_block_en_5.4.2_3.0_1724475525156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_block_en_5.4.2_3.0_1724475525156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_modelllo_block","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_modelllo_block", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_modelllo_block| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/wiktorw/my_awesome_opus_books_modelllo_block \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_pipeline_en.md new file mode 100644 index 00000000000000..06de7e0ee38092 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_awesome_opus_books_modelllo_block_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_modelllo_block_pipeline pipeline T5Transformer from wiktorw +author: John Snow Labs +name: burmese_awesome_opus_books_modelllo_block_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_modelllo_block_pipeline` is a English model originally trained by wiktorw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_block_pipeline_en_5.4.2_3.0_1724475543821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_block_pipeline_en_5.4.2_3.0_1724475543821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_modelllo_block_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_modelllo_block_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_modelllo_block_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/wiktorw/my_awesome_opus_books_modelllo_block + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_en.md new file mode 100644 index 00000000000000..31b858658bb2d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_first_model_from_finetune T5Transformer from vitokor +author: John Snow Labs +name: burmese_first_model_from_finetune +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_first_model_from_finetune` is a English model originally trained by vitokor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_first_model_from_finetune_en_5.4.2_3.0_1724532341117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_first_model_from_finetune_en_5.4.2_3.0_1724532341117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_first_model_from_finetune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_first_model_from_finetune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_first_model_from_finetune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|113.8 MB| + +## References + +https://huggingface.co/vitokor/my_first_model_from_finetune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_pipeline_en.md new file mode 100644 index 00000000000000..6635bf4273308d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_first_model_from_finetune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_first_model_from_finetune_pipeline pipeline T5Transformer from vitokor +author: John Snow Labs +name: burmese_first_model_from_finetune_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_first_model_from_finetune_pipeline` is a English model originally trained by vitokor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_first_model_from_finetune_pipeline_en_5.4.2_3.0_1724532346898.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_first_model_from_finetune_pipeline_en_5.4.2_3.0_1724532346898.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_first_model_from_finetune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_first_model_from_finetune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_first_model_from_finetune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|113.8 MB| + +## References + +https://huggingface.co/vitokor/my_first_model_from_finetune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_en.md new file mode 100644 index 00000000000000..0d93ec6268a216 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_squad_model T5Transformer from Rhasan97 +author: John Snow Labs +name: burmese_squad_model +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_squad_model` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_squad_model_en_5.4.2_3.0_1724467393228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_squad_model_en_5.4.2_3.0_1724467393228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_squad_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_squad_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_squad_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/Rhasan97/my-squad-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_pipeline_en.md new file mode 100644 index 00000000000000..0956c285377c52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-burmese_squad_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_squad_model_pipeline pipeline T5Transformer from Rhasan97 +author: John Snow Labs +name: burmese_squad_model_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_squad_model_pipeline` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_squad_model_pipeline_en_5.4.2_3.0_1724467411177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_squad_model_pipeline_en_5.4.2_3.0_1724467411177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_squad_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_squad_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_squad_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/Rhasan97/my-squad-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_en.md b/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_en.md new file mode 100644 index 00000000000000..962d19190e7147 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English catalan_t5_67 T5Transformer from foscraft +author: John Snow Labs +name: catalan_t5_67 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catalan_t5_67` is a English model originally trained by foscraft. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catalan_t5_67_en_5.4.2_3.0_1724502916141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catalan_t5_67_en_5.4.2_3.0_1724502916141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("catalan_t5_67","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("catalan_t5_67", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catalan_t5_67| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/foscraft/ca-t5-67 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_pipeline_en.md new file mode 100644 index 00000000000000..f9eecd78fb6c2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-catalan_t5_67_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English catalan_t5_67_pipeline pipeline T5Transformer from foscraft +author: John Snow Labs +name: catalan_t5_67_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catalan_t5_67_pipeline` is a English model originally trained by foscraft. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catalan_t5_67_pipeline_en_5.4.2_3.0_1724502939004.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catalan_t5_67_pipeline_en_5.4.2_3.0_1724502939004.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("catalan_t5_67_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("catalan_t5_67_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catalan_t5_67_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/foscraft/ca-t5-67 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_en.md b/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_en.md new file mode 100644 index 00000000000000..c7d838b2ed3015 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cdc_influenza T5Transformer from PergaZuZ +author: John Snow Labs +name: cdc_influenza +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cdc_influenza` is a English model originally trained by PergaZuZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cdc_influenza_en_5.4.2_3.0_1724517192476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cdc_influenza_en_5.4.2_3.0_1724517192476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cdc_influenza","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cdc_influenza", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cdc_influenza| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|279.3 MB| + +## References + +https://huggingface.co/PergaZuZ/cdc_influenza \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_pipeline_en.md new file mode 100644 index 00000000000000..b3007f2050d453 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cdc_influenza_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cdc_influenza_pipeline pipeline T5Transformer from PergaZuZ +author: John Snow Labs +name: cdc_influenza_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cdc_influenza_pipeline` is a English model originally trained by PergaZuZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cdc_influenza_pipeline_en_5.4.2_3.0_1724517221027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cdc_influenza_pipeline_en_5.4.2_3.0_1724517221027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cdc_influenza_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cdc_influenza_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cdc_influenza_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|279.3 MB| + +## References + +https://huggingface.co/PergaZuZ/cdc_influenza + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_en.md b/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_en.md new file mode 100644 index 00000000000000..32f3dd89478d2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English chenyu_mask_32 T5Transformer from yuan-sf63 +author: John Snow Labs +name: chenyu_mask_32 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chenyu_mask_32` is a English model originally trained by yuan-sf63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chenyu_mask_32_en_5.4.2_3.0_1724462696568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chenyu_mask_32_en_5.4.2_3.0_1724462696568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("chenyu_mask_32","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("chenyu_mask_32", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chenyu_mask_32| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/yuan-sf63/chenyu_mask_32_ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_pipeline_en.md new file mode 100644 index 00000000000000..d4573e3055cdf4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-chenyu_mask_32_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English chenyu_mask_32_pipeline pipeline T5Transformer from yuan-sf63 +author: John Snow Labs +name: chenyu_mask_32_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chenyu_mask_32_pipeline` is a English model originally trained by yuan-sf63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chenyu_mask_32_pipeline_en_5.4.2_3.0_1724462842251.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chenyu_mask_32_pipeline_en_5.4.2_3.0_1724462842251.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("chenyu_mask_32_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("chenyu_mask_32_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chenyu_mask_32_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/yuan-sf63/chenyu_mask_32_ + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_en.md b/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_en.md new file mode 100644 index 00000000000000..5baad67daf61f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4 T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_en_5.4.2_3.0_1724510709367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_en_5.4.2_3.0_1724510709367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_10_3000_6_e-1_s6789_v4_l4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline_en.md new file mode 100644 index 00000000000000..c44c44cedc4b43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline pipeline T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724510729245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724510729245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_10_3000_6_e_1_s6789_v4_l4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.9 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_10_3000_6_e-1_s6789_v4_l4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_en.md b/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_en.md new file mode 100644 index 00000000000000..000b165a91af22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_news_summary_model_trained_on_reduced_data_alz258 T5Transformer from alz258 +author: John Snow Labs +name: cnn_news_summary_model_trained_on_reduced_data_alz258 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_news_summary_model_trained_on_reduced_data_alz258` is a English model originally trained by alz258. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_alz258_en_5.4.2_3.0_1724501444916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_alz258_en_5.4.2_3.0_1724501444916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_news_summary_model_trained_on_reduced_data_alz258","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_news_summary_model_trained_on_reduced_data_alz258", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_news_summary_model_trained_on_reduced_data_alz258| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.2 MB| + +## References + +https://huggingface.co/alz258/cnn_news_summary_model_trained_on_reduced_data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline_en.md new file mode 100644 index 00000000000000..197074d3df762a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline pipeline T5Transformer from alz258 +author: John Snow Labs +name: cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline` is a English model originally trained by alz258. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline_en_5.4.2_3.0_1724501466349.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline_en_5.4.2_3.0_1724501466349.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_news_summary_model_trained_on_reduced_data_alz258_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.2 MB| + +## References + +https://huggingface.co/alz258/cnn_news_summary_model_trained_on_reduced_data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_en.md b/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_en.md new file mode 100644 index 00000000000000..be77aa1b3838b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English codefix_e20 T5Transformer from Roy029 +author: John Snow Labs +name: codefix_e20 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`codefix_e20` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/codefix_e20_en_5.4.2_3.0_1724543304789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/codefix_e20_en_5.4.2_3.0_1724543304789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("codefix_e20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("codefix_e20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|codefix_e20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Roy029/codefix_e20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_pipeline_en.md new file mode 100644 index 00000000000000..355b46cc4c0f05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-codefix_e20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English codefix_e20_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: codefix_e20_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`codefix_e20_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/codefix_e20_pipeline_en_5.4.2_3.0_1724543469488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/codefix_e20_pipeline_en_5.4.2_3.0_1724543469488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("codefix_e20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("codefix_e20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|codefix_e20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Roy029/codefix_e20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cptmetaqakginfusedlm20_en.md b/docs/_posts/ahmedlone127/2024-08-24-cptmetaqakginfusedlm20_en.md new file mode 100644 index 00000000000000..db7906a247049b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cptmetaqakginfusedlm20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cptmetaqakginfusedlm20 T5Transformer from sakharamg +author: John Snow Labs +name: cptmetaqakginfusedlm20 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptmetaqakginfusedlm20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptmetaqakginfusedlm20_en_5.4.2_3.0_1724521501922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptmetaqakginfusedlm20_en_5.4.2_3.0_1724521501922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cptmetaqakginfusedlm20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cptmetaqakginfusedlm20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptmetaqakginfusedlm20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTmetaqaKGinfusedLM20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_en.md b/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_en.md new file mode 100644 index 00000000000000..e6787ef70d7c5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cptt5largewithaviationcorpusaviationtriples20 T5Transformer from sakharamg +author: John Snow Labs +name: cptt5largewithaviationcorpusaviationtriples20 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptt5largewithaviationcorpusaviationtriples20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpusaviationtriples20_en_5.4.2_3.0_1724530484814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpusaviationtriples20_en_5.4.2_3.0_1724530484814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cptt5largewithaviationcorpusaviationtriples20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cptt5largewithaviationcorpusaviationtriples20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptt5largewithaviationcorpusaviationtriples20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTT5largewithaviationcorpusaviationtriples20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_pipeline_en.md new file mode 100644 index 00000000000000..7b382d520854b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cptt5largewithaviationcorpusaviationtriples20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cptt5largewithaviationcorpusaviationtriples20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cptt5largewithaviationcorpusaviationtriples20_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptt5largewithaviationcorpusaviationtriples20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpusaviationtriples20_pipeline_en_5.4.2_3.0_1724530624141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpusaviationtriples20_pipeline_en_5.4.2_3.0_1724530624141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cptt5largewithaviationcorpusaviationtriples20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cptt5largewithaviationcorpusaviationtriples20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptt5largewithaviationcorpusaviationtriples20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTT5largewithaviationcorpusaviationtriples20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_en.md new file mode 100644 index 00000000000000..7a642b55211ca0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_instruction1_aspol T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_instruction1_aspol +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_instruction1_aspol` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction1_aspol_en_5.4.2_3.0_1724458954816.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction1_aspol_en_5.4.2_3.0_1724458954816.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_instruction1_aspol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_instruction1_aspol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_instruction1_aspol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_Instruction1_ASPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_pipeline_en.md new file mode 100644 index 00000000000000..988d71ac8adace --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_instruction1_aspol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_instruction1_aspol_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_instruction1_aspol_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_instruction1_aspol_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction1_aspol_pipeline_en_5.4.2_3.0_1724459132462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction1_aspol_pipeline_en_5.4.2_3.0_1724459132462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_instruction1_aspol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_instruction1_aspol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_instruction1_aspol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_Instruction1_ASPOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_en.md new file mode 100644 index 00000000000000..2671eb36bfbb6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_en_5.4.2_3.0_1724527406446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_en_5.4.2_3.0_1724527406446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_label2text_ap2_inherit \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline_en.md new file mode 100644 index 00000000000000..911fa029abe7ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline_en_5.4.2_3.0_1724527578110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline_en_5.4.2_3.0_1724527578110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_label2text_ap2_inherit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_label2text_ap2_inherit + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_en.md new file mode 100644 index 00000000000000..743b95fdbb5a87 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting9_aspol T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting9_aspol +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting9_aspol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting9_aspol_en_5.4.2_3.0_1724522511821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting9_aspol_en_5.4.2_3.0_1724522511821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting9_aspol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting9_aspol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting9_aspol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting9_ASPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_pipeline_en.md new file mode 100644 index 00000000000000..154f81d96df2a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_prompting9_aspol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting9_aspol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting9_aspol_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting9_aspol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting9_aspol_pipeline_en_5.4.2_3.0_1724522680693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting9_aspol_pipeline_en_5.4.2_3.0_1724522680693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting9_aspol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting9_aspol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting9_aspol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting9_ASPOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_osapl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_osapl_v1_h1_en.md new file mode 100644 index 00000000000000..5cbed0f8ab2244 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_osapl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_osapl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_osapl_v1_h1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_osapl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_osapl_v1_h1_en_5.4.2_3.0_1724533701953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_osapl_v1_h1_en_5.4.2_3.0_1724533701953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_osapl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_osapl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_osapl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_OSAPL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_en.md new file mode 100644 index 00000000000000..0ce5bb550b9d61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_soapl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_soapl_v1_h1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_soapl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_h1_en_5.4.2_3.0_1724536667188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_h1_en_5.4.2_3.0_1724536667188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_soapl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_soapl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_soapl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOAPL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..f0731417fc8fe0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline_en_5.4.2_3.0_1724536840487.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline_en_5.4.2_3.0_1724536840487.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_soapl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOAPL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_en.md new file mode 100644 index 00000000000000..56426723662d74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_h4 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_h4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_h4` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h4_en_5.4.2_3.0_1724494770868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h4_en_5.4.2_3.0_1724494770868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_h4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_h4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_h4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_h4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline_en.md new file mode 100644 index 00000000000000..3aa3b659ceebc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline_en_5.4.2_3.0_1724494948845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline_en_5.4.2_3.0_1724494948845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_h4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_h4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_en.md new file mode 100644 index 00000000000000..1565895ec00ed0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_posal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_posal_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_posal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_posal_v1_en_5.4.2_3.0_1724487856923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_posal_v1_en_5.4.2_3.0_1724487856923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_posal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_posal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_posal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_POSAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_pipeline_en.md new file mode 100644 index 00000000000000..e8d6d7b0d30bd3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instruction4_posal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_posal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_posal_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_posal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_posal_v1_pipeline_en_5.4.2_3.0_1724488033315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_posal_v1_pipeline_en_5.4.2_3.0_1724488033315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction4_posal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction4_posal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_posal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_POSAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_en.md new file mode 100644 index 00000000000000..89803d45d65c5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aopsl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aopsl_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aopsl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aopsl_v1_en_5.4.2_3.0_1724509576161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aopsl_v1_en_5.4.2_3.0_1724509576161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aopsl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aopsl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aopsl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_AOPSL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline_en.md new file mode 100644 index 00000000000000..8381efbd4536c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline_en_5.4.2_3.0_1724509746286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline_en_5.4.2_3.0_1724509746286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aopsl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_AOPSL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_en.md new file mode 100644 index 00000000000000..844f690210a295 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_apsol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_apsol_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_apsol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_apsol_v1_en_5.4.2_3.0_1724515796839.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_apsol_v1_en_5.4.2_3.0_1724515796839.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_apsol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_apsol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_apsol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_APSOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline_en.md new file mode 100644 index 00000000000000..782db2a11fa199 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline_en_5.4.2_3.0_1724515971048.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline_en_5.4.2_3.0_1724515971048.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_apsol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_APSOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_en.md new file mode 100644 index 00000000000000..d8f08f78df3c73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_asopl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_asopl_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_asopl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_asopl_v1_en_5.4.2_3.0_1724514003299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_asopl_v1_en_5.4.2_3.0_1724514003299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_asopl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_asopl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_asopl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_ASOPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline_en.md new file mode 100644 index 00000000000000..6d48726d85ae2f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline_en_5.4.2_3.0_1724514171860.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline_en_5.4.2_3.0_1724514171860.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_asopl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_ASOPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_en.md new file mode 100644 index 00000000000000..aedb9306a8e889 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn5_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn5_soapl_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn5_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn5_soapl_v1_en_5.4.2_3.0_1724518766677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn5_soapl_v1_en_5.4.2_3.0_1724518766677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn5_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn5_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn5_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN5_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..a2fdf98a7cac83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline_en_5.4.2_3.0_1724518933724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline_en_5.4.2_3.0_1724518933724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn5_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN5_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_en.md b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_en.md new file mode 100644 index 00000000000000..b50ec5be912149 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dgslow_t5_small_bst_70epoch T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_bst_70epoch +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_bst_70epoch` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_70epoch_en_5.4.2_3.0_1724467987007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_70epoch_en_5.4.2_3.0_1724467987007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dgslow_t5_small_bst_70epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dgslow_t5_small_bst_70epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_bst_70epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.1 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_BST_70epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_pipeline_en.md new file mode 100644 index 00000000000000..ff8d656f7aed0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_bst_70epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dgslow_t5_small_bst_70epoch_pipeline pipeline T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_bst_70epoch_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_bst_70epoch_pipeline` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_70epoch_pipeline_en_5.4.2_3.0_1724468046327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_70epoch_pipeline_en_5.4.2_3.0_1724468046327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dgslow_t5_small_bst_70epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dgslow_t5_small_bst_70epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_bst_70epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.1 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_BST_70epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_en.md b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_en.md new file mode 100644 index 00000000000000..541cf6ff0d4e6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dgslow_t5_small_cv2 T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_cv2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_cv2` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_cv2_en_5.4.2_3.0_1724480722528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_cv2_en_5.4.2_3.0_1724480722528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dgslow_t5_small_cv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dgslow_t5_small_cv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_cv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.9 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_CV2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_pipeline_en.md new file mode 100644 index 00000000000000..21851acf505d4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dgslow_t5_small_cv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dgslow_t5_small_cv2_pipeline pipeline T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_cv2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_cv2_pipeline` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_cv2_pipeline_en_5.4.2_3.0_1724480742945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_cv2_pipeline_en_5.4.2_3.0_1724480742945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dgslow_t5_small_cv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dgslow_t5_small_cv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_cv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.9 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_CV2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_en.md b/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_en.md new file mode 100644 index 00000000000000..3305bc7b4b0d05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialogue_rewriter_aoyuqc T5Transformer from aoyuqc +author: John Snow Labs +name: dialogue_rewriter_aoyuqc +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_rewriter_aoyuqc` is a English model originally trained by aoyuqc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_rewriter_aoyuqc_en_5.4.2_3.0_1724500340016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_rewriter_aoyuqc_en_5.4.2_3.0_1724500340016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialogue_rewriter_aoyuqc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialogue_rewriter_aoyuqc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_rewriter_aoyuqc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.1 MB| + +## References + +https://huggingface.co/aoyuqc/dialogue-rewriter \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_pipeline_en.md new file mode 100644 index 00000000000000..3c535d78135b22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dialogue_rewriter_aoyuqc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialogue_rewriter_aoyuqc_pipeline pipeline T5Transformer from aoyuqc +author: John Snow Labs +name: dialogue_rewriter_aoyuqc_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_rewriter_aoyuqc_pipeline` is a English model originally trained by aoyuqc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_rewriter_aoyuqc_pipeline_en_5.4.2_3.0_1724500515462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_rewriter_aoyuqc_pipeline_en_5.4.2_3.0_1724500515462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialogue_rewriter_aoyuqc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialogue_rewriter_aoyuqc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_rewriter_aoyuqc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.1 MB| + +## References + +https://huggingface.co/aoyuqc/dialogue-rewriter + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_en.md new file mode 100644 index 00000000000000..4402ef1c04c129 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_0_25 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_25_en_5.4.2_3.0_1724479936295.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_25_en_5.4.2_3.0_1724479936295.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_pipeline_en.md new file mode 100644 index 00000000000000..a1fab0c6b99128 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_0_25_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_25_pipeline_en_5.4.2_3.0_1724480124756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_25_pipeline_en_5.4.2_3.0_1724480124756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_en.md new file mode 100644 index 00000000000000..b2f39ab631c54f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099_1_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_1_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_1_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_1_5_en_5.4.2_3.0_1724488975148.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_1_5_en_5.4.2_3.0_1724488975148.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099_1_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099_1_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_1_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-1.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_pipeline_en.md new file mode 100644 index 00000000000000..a071f3c30c4d32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_010099_1_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_1_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_1_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_1_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_1_5_pipeline_en_5.4.2_3.0_1724489164045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_1_5_pipeline_en_5.4.2_3.0_1724489164045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_1_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_1_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_1_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-1.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_en.md new file mode 100644 index 00000000000000..bfb76dd53de7c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_0_25 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_25_en_5.4.2_3.0_1724505491355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_25_en_5.4.2_3.0_1724505491355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_pipeline_en.md new file mode 100644 index 00000000000000..b25f3d4dfa6531 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_0_25_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_25_pipeline_en_5.4.2_3.0_1724505682461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_25_pipeline_en_5.4.2_3.0_1724505682461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_005_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_005_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_en.md new file mode 100644 index 00000000000000..e0efcdd11fcc43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_0_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_5_en_5.4.2_3.0_1724474515729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_5_en_5.4.2_3.0_1724474515729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_005_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_pipeline_en.md new file mode 100644 index 00000000000000..6872a5da2db599 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_005_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_005_0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_005_0_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_005_0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_5_pipeline_en_5.4.2_3.0_1724474704126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_005_0_5_pipeline_en_5.4.2_3.0_1724474704126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_005_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_005_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_005_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.005-0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_en.md new file mode 100644 index 00000000000000..68645b01d3e6ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_0_25 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_25_en_5.4.2_3.0_1724475167700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_25_en_5.4.2_3.0_1724475167700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_pipeline_en.md new file mode 100644 index 00000000000000..7be40da0ceba7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_02_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_0_25_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_25_pipeline_en_5.4.2_3.0_1724475348200.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_25_pipeline_en_5.4.2_3.0_1724475348200.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_02_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_02_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_en.md new file mode 100644 index 00000000000000..6a3f67e7329cc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_5_en_5.4.2_3.0_1724490362163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_5_en_5.4.2_3.0_1724490362163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_pipeline_en.md new file mode 100644 index 00000000000000..79ef2808f82f73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_2_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_5_pipeline_en_5.4.2_3.0_1724490549721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_5_pipeline_en_5.4.2_3.0_1724490549721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_2_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_2_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_en.md new file mode 100644 index 00000000000000..f66ce7d2d0c01d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_5_en_5.4.2_3.0_1724490922455.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_5_en_5.4.2_3.0_1724490922455.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_pipeline_en.md new file mode 100644 index 00000000000000..bc3fff3d849ca8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_6_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_5_pipeline_en_5.4.2_3.0_1724491110813.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_5_pipeline_en_5.4.2_3.0_1724491110813.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_6_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_6_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_en.md new file mode 100644 index 00000000000000..47e36ac6c57576 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_1_en_5.4.2_3.0_1724516103282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_1_en_5.4.2_3.0_1724516103282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_pipeline_en.md new file mode 100644 index 00000000000000..22d00d7792fb7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_0_8_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_1_pipeline_en_5.4.2_3.0_1724516296890.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_1_pipeline_en_5.4.2_3.0_1724516296890.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_8_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_8_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_en.md new file mode 100644 index 00000000000000..ee8997103cb126 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b100 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b100 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b100` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b100_en_5.4.2_3.0_1724511165697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b100_en_5.4.2_3.0_1724511165697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b100","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b100", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b100| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b100 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_pipeline_en.md new file mode 100644 index 00000000000000..69429fbb67f349 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilled_mt5_small_b100_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b100_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b100_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b100_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b100_pipeline_en_5.4.2_3.0_1724511345308.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b100_pipeline_en_5.4.2_3.0_1724511345308.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b100_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b100_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b100_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b100 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_en.md new file mode 100644 index 00000000000000..1f4a40eec6f97c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilt5_qa_qg_hl_6_4 T5Transformer from valhalla +author: John Snow Labs +name: distilt5_qa_qg_hl_6_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilt5_qa_qg_hl_6_4` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilt5_qa_qg_hl_6_4_en_5.4.2_3.0_1724458030176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilt5_qa_qg_hl_6_4_en_5.4.2_3.0_1724458030176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilt5_qa_qg_hl_6_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilt5_qa_qg_hl_6_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilt5_qa_qg_hl_6_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.0 MB| + +## References + +https://huggingface.co/valhalla/distilt5-qa-qg-hl-6-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_pipeline_en.md new file mode 100644 index 00000000000000..0754e1799703f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-distilt5_qa_qg_hl_6_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilt5_qa_qg_hl_6_4_pipeline pipeline T5Transformer from valhalla +author: John Snow Labs +name: distilt5_qa_qg_hl_6_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilt5_qa_qg_hl_6_4_pipeline` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilt5_qa_qg_hl_6_4_pipeline_en_5.4.2_3.0_1724458045382.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilt5_qa_qg_hl_6_4_pipeline_en_5.4.2_3.0_1724458045382.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilt5_qa_qg_hl_6_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilt5_qa_qg_hl_6_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilt5_qa_qg_hl_6_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.0 MB| + +## References + +https://huggingface.co/valhalla/distilt5-qa-qg-hl-6-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_en.md b/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_en.md new file mode 100644 index 00000000000000..3e2cb5d1b16ec7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English doc2query_ppo_msmarco_8192_mini_121 T5Transformer from Hermi2023 +author: John Snow Labs +name: doc2query_ppo_msmarco_8192_mini_121 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_ppo_msmarco_8192_mini_121` is a English model originally trained by Hermi2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_8192_mini_121_en_5.4.2_3.0_1724498162779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_8192_mini_121_en_5.4.2_3.0_1724498162779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("doc2query_ppo_msmarco_8192_mini_121","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("doc2query_ppo_msmarco_8192_mini_121", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_ppo_msmarco_8192_mini_121| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.0 MB| + +## References + +https://huggingface.co/Hermi2023/doc2query-ppo-msmarco-8192-mini-121 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_pipeline_en.md new file mode 100644 index 00000000000000..6f910f99c935f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-doc2query_ppo_msmarco_8192_mini_121_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English doc2query_ppo_msmarco_8192_mini_121_pipeline pipeline T5Transformer from Hermi2023 +author: John Snow Labs +name: doc2query_ppo_msmarco_8192_mini_121_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_ppo_msmarco_8192_mini_121_pipeline` is a English model originally trained by Hermi2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_8192_mini_121_pipeline_en_5.4.2_3.0_1724498221785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_8192_mini_121_pipeline_en_5.4.2_3.0_1724498221785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("doc2query_ppo_msmarco_8192_mini_121_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("doc2query_ppo_msmarco_8192_mini_121_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_ppo_msmarco_8192_mini_121_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.0 MB| + +## References + +https://huggingface.co/Hermi2023/doc2query-ppo-msmarco-8192-mini-121 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_en.md new file mode 100644 index 00000000000000..debae3d430fea6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English du_ge_all_2 T5Transformer from Bistolero +author: John Snow Labs +name: du_ge_all_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`du_ge_all_2` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/du_ge_all_2_en_5.4.2_3.0_1724543591563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/du_ge_all_2_en_5.4.2_3.0_1724543591563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("du_ge_all_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("du_ge_all_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|du_ge_all_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/du_ge_all_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_pipeline_en.md new file mode 100644 index 00000000000000..673edc2057e28e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-du_ge_all_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English du_ge_all_2_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: du_ge_all_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`du_ge_all_2_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/du_ge_all_2_pipeline_en_5.4.2_3.0_1724543741844.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/du_ge_all_2_pipeline_en_5.4.2_3.0_1724543741844.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("du_ge_all_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("du_ge_all_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|du_ge_all_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/du_ge_all_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_en.md new file mode 100644 index 00000000000000..f9cbcddccf4710 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dutch_ge_25_25_4b_northern_sami T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_25_25_4b_northern_sami +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_25_25_4b_northern_sami` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_25_25_4b_northern_sami_en_5.4.2_3.0_1724532463245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_25_25_4b_northern_sami_en_5.4.2_3.0_1724532463245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_ge_25_25_4b_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_ge_25_25_4b_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_25_25_4b_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_25_25_4b_se \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_pipeline_en.md new file mode 100644 index 00000000000000..bbd30edb3145e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_25_25_4b_northern_sami_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dutch_ge_25_25_4b_northern_sami_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_25_25_4b_northern_sami_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_25_25_4b_northern_sami_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_25_25_4b_northern_sami_pipeline_en_5.4.2_3.0_1724532617070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_25_25_4b_northern_sami_pipeline_en_5.4.2_3.0_1724532617070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_ge_25_25_4b_northern_sami_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_ge_25_25_4b_northern_sami_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_25_25_4b_northern_sami_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_25_25_4b_se + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_en.md new file mode 100644 index 00000000000000..fce24a4c43dad5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dutch_ge_nepal_bhasa_17ksamples T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_nepal_bhasa_17ksamples +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_nepal_bhasa_17ksamples` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_nepal_bhasa_17ksamples_en_5.4.2_3.0_1724498646628.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_nepal_bhasa_17ksamples_en_5.4.2_3.0_1724498646628.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_ge_nepal_bhasa_17ksamples","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_ge_nepal_bhasa_17ksamples", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_nepal_bhasa_17ksamples| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_new_17ksamples \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_pipeline_en.md new file mode 100644 index 00000000000000..53552d6c79a283 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_ge_nepal_bhasa_17ksamples_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dutch_ge_nepal_bhasa_17ksamples_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_nepal_bhasa_17ksamples_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_nepal_bhasa_17ksamples_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_nepal_bhasa_17ksamples_pipeline_en_5.4.2_3.0_1724498816827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_nepal_bhasa_17ksamples_pipeline_en_5.4.2_3.0_1724498816827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_ge_nepal_bhasa_17ksamples_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_ge_nepal_bhasa_17ksamples_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_nepal_bhasa_17ksamples_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_new_17ksamples + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_en.md new file mode 100644 index 00000000000000..1776a375c55bba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dutch_irish_32b T5Transformer from Bistolero +author: John Snow Labs +name: dutch_irish_32b +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_irish_32b` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_irish_32b_en_5.4.2_3.0_1724527784311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_irish_32b_en_5.4.2_3.0_1724527784311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_irish_32b","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_irish_32b", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_irish_32b| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl_GA_32b \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_pipeline_en.md new file mode 100644 index 00000000000000..f66ea9d671de2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_irish_32b_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dutch_irish_32b_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: dutch_irish_32b_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_irish_32b_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_irish_32b_pipeline_en_5.4.2_3.0_1724527952566.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_irish_32b_pipeline_en_5.4.2_3.0_1724527952566.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_irish_32b_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_irish_32b_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_irish_32b_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/nl_GA_32b + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_en.md new file mode 100644 index 00000000000000..b43cb50caeacdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex T5Transformer from rymaju +author: John Snow Labs +name: dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724515034140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724515034140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rymaju/NL-RX-Synth-t5-base-finetuned-en-to-regex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md new file mode 100644 index 00000000000000..e3081f0a5b50af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline pipeline T5Transformer from rymaju +author: John Snow Labs +name: dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724515082896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724515082896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_rx_synth_t5_base_finetuned_english_tonga_tonga_islands_regex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rymaju/NL-RX-Synth-t5-base-finetuned-en-to-regex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-emot5_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-emot5_english_en.md new file mode 100644 index 00000000000000..c48eabfba648fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-emot5_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English emot5_english T5Transformer from NLPinas +author: John Snow Labs +name: emot5_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`emot5_english` is a English model originally trained by NLPinas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/emot5_english_en_5.4.2_3.0_1724542526073.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/emot5_english_en_5.4.2_3.0_1724542526073.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("emot5_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("emot5_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|emot5_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/NLPinas/EMoT5-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_en.md new file mode 100644 index 00000000000000..38724fa32bad8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English energy_t5_large T5Transformer from krkv +author: John Snow Labs +name: energy_t5_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`energy_t5_large` is a English model originally trained by krkv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/energy_t5_large_en_5.4.2_3.0_1724509254674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/energy_t5_large_en_5.4.2_3.0_1724509254674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("energy_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("energy_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|energy_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/krkv/energy-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..303d6074ab9aee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-energy_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English energy_t5_large_pipeline pipeline T5Transformer from krkv +author: John Snow Labs +name: energy_t5_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`energy_t5_large_pipeline` is a English model originally trained by krkv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/energy_t5_large_pipeline_en_5.4.2_3.0_1724509394606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/energy_t5_large_pipeline_en_5.4.2_3.0_1724509394606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("energy_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("energy_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|energy_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/krkv/energy-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_en.md new file mode 100644 index 00000000000000..4fee5ad8c5aba6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_french_translator_esthert T5Transformer from EstherT +author: John Snow Labs +name: english_french_translator_esthert +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_french_translator_esthert` is a English model originally trained by EstherT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_french_translator_esthert_en_5.4.2_3.0_1724465114970.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_french_translator_esthert_en_5.4.2_3.0_1724465114970.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_french_translator_esthert","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_french_translator_esthert", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_french_translator_esthert| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/EstherT/en-fr_translator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_pipeline_en.md new file mode 100644 index 00000000000000..12f0dc4bdb87cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_french_translator_esthert_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_french_translator_esthert_pipeline pipeline T5Transformer from EstherT +author: John Snow Labs +name: english_french_translator_esthert_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_french_translator_esthert_pipeline` is a English model originally trained by EstherT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_french_translator_esthert_pipeline_en_5.4.2_3.0_1724465166757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_french_translator_esthert_pipeline_en_5.4.2_3.0_1724465166757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_french_translator_esthert_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_french_translator_esthert_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_french_translator_esthert_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/EstherT/en-fr_translator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_en.md new file mode 100644 index 00000000000000..df0242a47f8a86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_german_turkish_ted T5Transformer from RocioUrquijo +author: John Snow Labs +name: english_german_turkish_ted +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_german_turkish_ted` is a English model originally trained by RocioUrquijo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_german_turkish_ted_en_5.4.2_3.0_1724519821201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_german_turkish_ted_en_5.4.2_3.0_1724519821201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_german_turkish_ted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_german_turkish_ted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_german_turkish_ted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|949.1 MB| + +## References + +https://huggingface.co/RocioUrquijo/EN-DE-TR-TED \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_pipeline_en.md new file mode 100644 index 00000000000000..3d6e81504f7cd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_german_turkish_ted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_german_turkish_ted_pipeline pipeline T5Transformer from RocioUrquijo +author: John Snow Labs +name: english_german_turkish_ted_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_german_turkish_ted_pipeline` is a English model originally trained by RocioUrquijo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_german_turkish_ted_pipeline_en_5.4.2_3.0_1724519873516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_german_turkish_ted_pipeline_en_5.4.2_3.0_1724519873516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_german_turkish_ted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_german_turkish_ted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_german_turkish_ted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|949.1 MB| + +## References + +https://huggingface.co/RocioUrquijo/EN-DE-TR-TED + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_en.md new file mode 100644 index 00000000000000..00f4f788ffbf2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_hindi_bleu T5Transformer from SoyGema +author: John Snow Labs +name: english_hindi_bleu +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_hindi_bleu` is a English model originally trained by SoyGema. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_hindi_bleu_en_5.4.2_3.0_1724458513744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_hindi_bleu_en_5.4.2_3.0_1724458513744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_hindi_bleu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_hindi_bleu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_hindi_bleu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/SoyGema/english-hindi-bleu \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_pipeline_en.md new file mode 100644 index 00000000000000..64f378a4bdbb09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-english_hindi_bleu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_hindi_bleu_pipeline pipeline T5Transformer from SoyGema +author: John Snow Labs +name: english_hindi_bleu_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_hindi_bleu_pipeline` is a English model originally trained by SoyGema. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_hindi_bleu_pipeline_en_5.4.2_3.0_1724458538549.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_hindi_bleu_pipeline_en_5.4.2_3.0_1724458538549.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_hindi_bleu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_hindi_bleu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_hindi_bleu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/SoyGema/english-hindi-bleu + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_en.md new file mode 100644 index 00000000000000..4b68b69fb13914 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English esnli_limited_e_10_alpha_0_5 T5Transformer from harish +author: John Snow Labs +name: esnli_limited_e_10_alpha_0_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`esnli_limited_e_10_alpha_0_5` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/esnli_limited_e_10_alpha_0_5_en_5.4.2_3.0_1724504791400.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/esnli_limited_e_10_alpha_0_5_en_5.4.2_3.0_1724504791400.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("esnli_limited_e_10_alpha_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("esnli_limited_e_10_alpha_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|esnli_limited_e_10_alpha_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/harish/eSNLI-limited-e-10-alpha-0-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_pipeline_en.md new file mode 100644 index 00000000000000..c395d25a43c094 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-esnli_limited_e_10_alpha_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English esnli_limited_e_10_alpha_0_5_pipeline pipeline T5Transformer from harish +author: John Snow Labs +name: esnli_limited_e_10_alpha_0_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`esnli_limited_e_10_alpha_0_5_pipeline` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/esnli_limited_e_10_alpha_0_5_pipeline_en_5.4.2_3.0_1724504847195.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/esnli_limited_e_10_alpha_0_5_pipeline_en_5.4.2_3.0_1724504847195.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("esnli_limited_e_10_alpha_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("esnli_limited_e_10_alpha_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|esnli_limited_e_10_alpha_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/harish/eSNLI-limited-e-10-alpha-0-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_en.md b/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_en.md new file mode 100644 index 00000000000000..5d5cd5818a01f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English events_mem_small_norwegian_prompt T5Transformer from eddieman78 +author: John Snow Labs +name: events_mem_small_norwegian_prompt +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`events_mem_small_norwegian_prompt` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/events_mem_small_norwegian_prompt_en_5.4.2_3.0_1724489213769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/events_mem_small_norwegian_prompt_en_5.4.2_3.0_1724489213769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("events_mem_small_norwegian_prompt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("events_mem_small_norwegian_prompt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|events_mem_small_norwegian_prompt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/events-mem-small-no-prompt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_pipeline_en.md new file mode 100644 index 00000000000000..7016bba589eed6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-events_mem_small_norwegian_prompt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English events_mem_small_norwegian_prompt_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: events_mem_small_norwegian_prompt_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`events_mem_small_norwegian_prompt_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/events_mem_small_norwegian_prompt_pipeline_en_5.4.2_3.0_1724489230339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/events_mem_small_norwegian_prompt_pipeline_en_5.4.2_3.0_1724489230339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("events_mem_small_norwegian_prompt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("events_mem_small_norwegian_prompt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|events_mem_small_norwegian_prompt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/events-mem-small-no-prompt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_en.md new file mode 100644 index 00000000000000..17fc44e99764dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English evinspect_usb_flant5_large T5Transformer from kundank +author: John Snow Labs +name: evinspect_usb_flant5_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`evinspect_usb_flant5_large` is a English model originally trained by kundank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/evinspect_usb_flant5_large_en_5.4.2_3.0_1724537475452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/evinspect_usb_flant5_large_en_5.4.2_3.0_1724537475452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("evinspect_usb_flant5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("evinspect_usb_flant5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|evinspect_usb_flant5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/kundank/evinspect-usb-flant5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_pipeline_en.md new file mode 100644 index 00000000000000..1e7893b43702aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-evinspect_usb_flant5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English evinspect_usb_flant5_large_pipeline pipeline T5Transformer from kundank +author: John Snow Labs +name: evinspect_usb_flant5_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`evinspect_usb_flant5_large_pipeline` is a English model originally trained by kundank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/evinspect_usb_flant5_large_pipeline_en_5.4.2_3.0_1724537621556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/evinspect_usb_flant5_large_pipeline_en_5.4.2_3.0_1724537621556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("evinspect_usb_flant5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("evinspect_usb_flant5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|evinspect_usb_flant5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/kundank/evinspect-usb-flant5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_pipeline_tl.md b/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_pipeline_tl.md new file mode 100644 index 00000000000000..56c90720f98f23 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_pipeline_tl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Tagalog filipinolingo_translation_pipeline pipeline T5Transformer from youdiniplays +author: John Snow Labs +name: filipinolingo_translation_pipeline +date: 2024-08-24 +tags: [tl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: tl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`filipinolingo_translation_pipeline` is a Tagalog model originally trained by youdiniplays. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/filipinolingo_translation_pipeline_tl_5.4.2_3.0_1724495665857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/filipinolingo_translation_pipeline_tl_5.4.2_3.0_1724495665857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("filipinolingo_translation_pipeline", lang = "tl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("filipinolingo_translation_pipeline", lang = "tl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|filipinolingo_translation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|tl| +|Size:|316.5 MB| + +## References + +https://huggingface.co/youdiniplays/filipinolingo_translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_tl.md b/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_tl.md new file mode 100644 index 00000000000000..7040620e5a1f5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-filipinolingo_translation_tl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Tagalog filipinolingo_translation T5Transformer from youdiniplays +author: John Snow Labs +name: filipinolingo_translation +date: 2024-08-24 +tags: [tl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: tl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`filipinolingo_translation` is a Tagalog model originally trained by youdiniplays. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/filipinolingo_translation_tl_5.4.2_3.0_1724495641444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/filipinolingo_translation_tl_5.4.2_3.0_1724495641444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("filipinolingo_translation","tl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("filipinolingo_translation", "tl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|filipinolingo_translation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|tl| +|Size:|316.5 MB| + +## References + +https://huggingface.co/youdiniplays/filipinolingo_translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_en.md b/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_en.md new file mode 100644 index 00000000000000..59f83d1eaa5de0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_flan_t5_base_science_llm T5Transformer from Saugatkafley +author: John Snow Labs +name: fine_tuned_flan_t5_base_science_llm +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_flan_t5_base_science_llm` is a English model originally trained by Saugatkafley. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_base_science_llm_en_5.4.2_3.0_1724459920898.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_base_science_llm_en_5.4.2_3.0_1724459920898.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_flan_t5_base_science_llm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_flan_t5_base_science_llm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_flan_t5_base_science_llm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Saugatkafley/fine-tuned-flan-t5-base-science-LLM \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_pipeline_en.md new file mode 100644 index 00000000000000..0fb5b9057b7164 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-fine_tuned_flan_t5_base_science_llm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fine_tuned_flan_t5_base_science_llm_pipeline pipeline T5Transformer from Saugatkafley +author: John Snow Labs +name: fine_tuned_flan_t5_base_science_llm_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_flan_t5_base_science_llm_pipeline` is a English model originally trained by Saugatkafley. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_base_science_llm_pipeline_en_5.4.2_3.0_1724459968529.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_base_science_llm_pipeline_en_5.4.2_3.0_1724459968529.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fine_tuned_flan_t5_base_science_llm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fine_tuned_flan_t5_base_science_llm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_flan_t5_base_science_llm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Saugatkafley/fine-tuned-flan-t5-base-science-LLM + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..eb44a305af0eb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_isi_penting_generator_t5_base_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_isi_penting_generator_t5_base_standard_bahasa_cased +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_isi_penting_generator_t5_base_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_isi_penting_generator_t5_base_standard_bahasa_cased_en_5.4.2_3.0_1724479476045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_isi_penting_generator_t5_base_standard_bahasa_cased_en_5.4.2_3.0_1724479476045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_isi_penting_generator_t5_base_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_isi_penting_generator_t5_base_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_isi_penting_generator_t5_base_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mesolitica/finetune-isi-penting-generator-t5-base-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..4c22782c71ecfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724479522891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724479522891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_isi_penting_generator_t5_base_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mesolitica/finetune-isi-penting-generator-t5-base-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_en.md new file mode 100644 index 00000000000000..8e700017499452 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver1 T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver1` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver1_en_5.4.2_3.0_1724474316949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver1_en_5.4.2_3.0_1724474316949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_pipeline_en.md new file mode 100644 index 00000000000000..97dc9f5a0d3bef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetune_newwiki_summarization_ver1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver1_pipeline pipeline T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver1_pipeline` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver1_pipeline_en_5.4.2_3.0_1724474371427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver1_pipeline_en_5.4.2_3.0_1724474371427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_newwiki_summarization_ver1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_newwiki_summarization_ver1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_en.md new file mode 100644 index 00000000000000..9e4fd4e0f17caf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_baseline_phase_2 T5Transformer from ishwarbb23 +author: John Snow Labs +name: finetuned_baseline_phase_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_baseline_phase_2` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_baseline_phase_2_en_5.4.2_3.0_1724501642027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_baseline_phase_2_en_5.4.2_3.0_1724501642027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_baseline_phase_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_baseline_phase_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_baseline_phase_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/ishwarbb23/finetuned-baseline-phase-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_pipeline_en.md new file mode 100644 index 00000000000000..302e9ea8b7ee37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetuned_baseline_phase_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_baseline_phase_2_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: finetuned_baseline_phase_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_baseline_phase_2_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_baseline_phase_2_pipeline_en_5.4.2_3.0_1724501659209.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_baseline_phase_2_pipeline_en_5.4.2_3.0_1724501659209.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_baseline_phase_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_baseline_phase_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_baseline_phase_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/ishwarbb23/finetuned-baseline-phase-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_en.md new file mode 100644 index 00000000000000..46afd9a5b21322 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64 T5Transformer from liuyanchen1015 +author: John Snow Labs +name: finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_en_5.4.2_3.0_1724481697304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_en_5.4.2_3.0_1724481697304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/Finetuned_FLAN-T5_VALUE_adapterfusion_lr5e-5_bs64 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline_en.md new file mode 100644 index 00000000000000..b6ca0c9f6e7a5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline pipeline T5Transformer from liuyanchen1015 +author: John Snow Labs +name: finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline_en_5.4.2_3.0_1724481744976.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline_en_5.4.2_3.0_1724481744976.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_flan_t5_value_adapterfusion_lr5e_5_bs64_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/Finetuned_FLAN-T5_VALUE_adapterfusion_lr5e-5_bs64 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_en.md new file mode 100644 index 00000000000000..8108dd4de6bc6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_mix10e_prefixmiss T5Transformer from Roy029 +author: John Snow Labs +name: flan_mix10e_prefixmiss +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_mix10e_prefixmiss` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_mix10e_prefixmiss_en_5.4.2_3.0_1724541679452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_mix10e_prefixmiss_en_5.4.2_3.0_1724541679452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_mix10e_prefixmiss","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_mix10e_prefixmiss", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_mix10e_prefixmiss| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/Roy029/flan_mix10e_prefixmiss \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_pipeline_en.md new file mode 100644 index 00000000000000..05346a4d276387 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_mix10e_prefixmiss_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_mix10e_prefixmiss_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: flan_mix10e_prefixmiss_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_mix10e_prefixmiss_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_mix10e_prefixmiss_pipeline_en_5.4.2_3.0_1724541727555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_mix10e_prefixmiss_pipeline_en_5.4.2_3.0_1724541727555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_mix10e_prefixmiss_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_mix10e_prefixmiss_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_mix10e_prefixmiss_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/Roy029/flan_mix10e_prefixmiss + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_en.md new file mode 100644 index 00000000000000..7fb2bd8ab53a47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_oig_small T5Transformer from 0-hero +author: John Snow Labs +name: flan_oig_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_oig_small` is a English model originally trained by 0-hero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_oig_small_en_5.4.2_3.0_1724497816306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_oig_small_en_5.4.2_3.0_1724497816306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_oig_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_oig_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_oig_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/0-hero/flan-OIG-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_pipeline_en.md new file mode 100644 index 00000000000000..7afa25bcb715b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_oig_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_oig_small_pipeline pipeline T5Transformer from 0-hero +author: John Snow Labs +name: flan_oig_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_oig_small_pipeline` is a English model originally trained by 0-hero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_oig_small_pipeline_en_5.4.2_3.0_1724497833901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_oig_small_pipeline_en_5.4.2_3.0_1724497833901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_oig_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_oig_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_oig_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/0-hero/flan-OIG-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_en.md new file mode 100644 index 00000000000000..bc1b2688a84efa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_en_5.4.2_3.0_1724474660526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_en_5.4.2_3.0_1724474660526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_2000-all-hint_precision-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline_en.md new file mode 100644 index 00000000000000..a704e649ce1d20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724474709517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724474709517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_2000_all_hint_precision_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_2000-all-hint_precision-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_en.md new file mode 100644 index 00000000000000..103988c7e865ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_en_5.4.2_3.0_1724480393877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_en_5.4.2_3.0_1724480393877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_40000-all-hint_precision-ep50-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..4def10917d6ae8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline_en_5.4.2_3.0_1724480444604.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline_en_5.4.2_3.0_1724480444604.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_40000-all-hint_precision-ep50-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_en.md new file mode 100644 index 00000000000000..a1e9c532b51387 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_adj_mts_dialogue T5Transformer from hankym +author: John Snow Labs +name: flan_t5_base_finetuned_adj_mts_dialogue +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_adj_mts_dialogue` is a English model originally trained by hankym. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_adj_mts_dialogue_en_5.4.2_3.0_1724460702280.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_adj_mts_dialogue_en_5.4.2_3.0_1724460702280.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_adj_mts_dialogue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_adj_mts_dialogue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_adj_mts_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.3 MB| + +## References + +https://huggingface.co/hankym/flan_t5_base_finetuned_adj_MTS_dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_pipeline_en.md new file mode 100644 index 00000000000000..c4bc2f3db3c31b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_adj_mts_dialogue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_adj_mts_dialogue_pipeline pipeline T5Transformer from hankym +author: John Snow Labs +name: flan_t5_base_finetuned_adj_mts_dialogue_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_adj_mts_dialogue_pipeline` is a English model originally trained by hankym. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_adj_mts_dialogue_pipeline_en_5.4.2_3.0_1724460889809.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_adj_mts_dialogue_pipeline_en_5.4.2_3.0_1724460889809.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_adj_mts_dialogue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_adj_mts_dialogue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_adj_mts_dialogue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.3 MB| + +## References + +https://huggingface.co/hankym/flan_t5_base_finetuned_adj_MTS_dialogue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_en.md new file mode 100644 index 00000000000000..76a3b15126a645 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_sample_data_model T5Transformer from Nisit-Tripathi +author: John Snow Labs +name: flan_t5_base_finetuned_sample_data_model +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_sample_data_model` is a English model originally trained by Nisit-Tripathi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_sample_data_model_en_5.4.2_3.0_1724527274254.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_sample_data_model_en_5.4.2_3.0_1724527274254.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_sample_data_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_sample_data_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_sample_data_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nisit-Tripathi/flan-t5-base-finetuned-sample_data_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_pipeline_en.md new file mode 100644 index 00000000000000..7b1d3be5c8c122 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_sample_data_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_sample_data_model_pipeline pipeline T5Transformer from Nisit-Tripathi +author: John Snow Labs +name: flan_t5_base_finetuned_sample_data_model_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_sample_data_model_pipeline` is a English model originally trained by Nisit-Tripathi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_sample_data_model_pipeline_en_5.4.2_3.0_1724527320786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_sample_data_model_pipeline_en_5.4.2_3.0_1724527320786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_sample_data_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_sample_data_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_sample_data_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nisit-Tripathi/flan-t5-base-finetuned-sample_data_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_en.md new file mode 100644 index 00000000000000..ea41e39a172e3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_summaries_lpi T5Transformer from ViktorDo +author: John Snow Labs +name: flan_t5_base_finetuned_summaries_lpi +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_summaries_lpi` is a English model originally trained by ViktorDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_lpi_en_5.4.2_3.0_1724490803979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_lpi_en_5.4.2_3.0_1724490803979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_summaries_lpi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_summaries_lpi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_summaries_lpi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ViktorDo/flan-t5-base-finetuned-summaries-LPI \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_pipeline_en.md new file mode 100644 index 00000000000000..f0bf15a49c81a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_finetuned_summaries_lpi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_summaries_lpi_pipeline pipeline T5Transformer from ViktorDo +author: John Snow Labs +name: flan_t5_base_finetuned_summaries_lpi_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_summaries_lpi_pipeline` is a English model originally trained by ViktorDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_lpi_pipeline_en_5.4.2_3.0_1724490853664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_lpi_pipeline_en_5.4.2_3.0_1724490853664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_summaries_lpi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_summaries_lpi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_summaries_lpi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ViktorDo/flan-t5-base-finetuned-summaries-LPI + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_en.md new file mode 100644 index 00000000000000..2414c6a1fbdb36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_momina296 T5Transformer from momina296 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_momina296 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_momina296` is a English model originally trained by momina296. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_momina296_en_5.4.2_3.0_1724483994168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_momina296_en_5.4.2_3.0_1724483994168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_momina296","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_momina296", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_momina296| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/momina296/flan-t5-base-imdb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_pipeline_en.md new file mode 100644 index 00000000000000..b813dc67d20a3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_momina296_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_momina296_pipeline pipeline T5Transformer from momina296 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_momina296_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_momina296_pipeline` is a English model originally trained by momina296. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_momina296_pipeline_en_5.4.2_3.0_1724484047788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_momina296_pipeline_en_5.4.2_3.0_1724484047788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_imdb_text_classification_momina296_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_imdb_text_classification_momina296_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_momina296_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/momina296/flan-t5-base-imdb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_en.md new file mode 100644 index 00000000000000..f99ab492056599 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_rorschach_40 T5Transformer from rorschach-40 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_rorschach_40 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_rorschach_40` is a English model originally trained by rorschach-40. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_rorschach_40_en_5.4.2_3.0_1724531096837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_rorschach_40_en_5.4.2_3.0_1724531096837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_rorschach_40","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_rorschach_40", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_rorschach_40| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rorschach-40/flan-t5-base-imdb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_pipeline_en.md new file mode 100644 index 00000000000000..66e615106d383d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_imdb_text_classification_rorschach_40_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_rorschach_40_pipeline pipeline T5Transformer from rorschach-40 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_rorschach_40_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_rorschach_40_pipeline` is a English model originally trained by rorschach-40. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_rorschach_40_pipeline_en_5.4.2_3.0_1724531147068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_rorschach_40_pipeline_en_5.4.2_3.0_1724531147068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_imdb_text_classification_rorschach_40_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_imdb_text_classification_rorschach_40_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_rorschach_40_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rorschach-40/flan-t5-base-imdb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_en.md new file mode 100644 index 00000000000000..6b2de80bb575ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_squad_qg_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qg_ep10 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qg_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qg_ep10_en_5.4.2_3.0_1724478154793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qg_ep10_en_5.4.2_3.0_1724478154793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_squad_qg_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_squad_qg_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qg_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qg-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_pipeline_en.md new file mode 100644 index 00000000000000..38fdaa00c7ed08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_squad_qg_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_squad_qg_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qg_ep10_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qg_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qg_ep10_pipeline_en_5.4.2_3.0_1724478204434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qg_ep10_pipeline_en_5.4.2_3.0_1724478204434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_squad_qg_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_squad_qg_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qg_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qg-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_en.md new file mode 100644 index 00000000000000..eb2b65123125ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tobacco_intent T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_tobacco_intent +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tobacco_intent` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tobacco_intent_en_5.4.2_3.0_1724517938286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tobacco_intent_en_5.4.2_3.0_1724517938286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tobacco_intent","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tobacco_intent", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tobacco_intent| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-tobacco_intent \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_pipeline_en.md new file mode 100644 index 00000000000000..1962c7a43a639a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tobacco_intent_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tobacco_intent_pipeline pipeline T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_tobacco_intent_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tobacco_intent_pipeline` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tobacco_intent_pipeline_en_5.4.2_3.0_1724517987226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tobacco_intent_pipeline_en_5.4.2_3.0_1724517987226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tobacco_intent_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tobacco_intent_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tobacco_intent_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-tobacco_intent + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_en.md new file mode 100644 index 00000000000000..4c7518b4d64220 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_ner7 T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_ner7 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_ner7` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_ner7_en_5.4.2_3.0_1724475609095.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_ner7_en_5.4.2_3.0_1724475609095.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_ner7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_ner7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_ner7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-ner7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_pipeline_en.md new file mode 100644 index 00000000000000..ad62a55374cb16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_base_tweet_ner7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_ner7_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_ner7_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_ner7_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_ner7_pipeline_en_5.4.2_3.0_1724475662000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_ner7_pipeline_en_5.4.2_3.0_1724475662000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_ner7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_ner7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_ner7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-ner7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_en.md new file mode 100644 index 00000000000000..3c9b93ca3fb757 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_qa_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_qa_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_qa_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_en_5.4.2_3.0_1724465196462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_en_5.4.2_3.0_1724465196462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_qa_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_qa_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_qa_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-qa-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_pipeline_en.md new file mode 100644 index 00000000000000..d28f3b9e2bac00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_cbp_lkg_qa_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_qa_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_qa_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_qa_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_pipeline_en_5.4.2_3.0_1724465213590.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_pipeline_en_5.4.2_3.0_1724465213590.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_cbp_lkg_qa_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_cbp_lkg_qa_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_qa_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-qa-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_en.md new file mode 100644 index 00000000000000..e8a6597b6f038f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_continuity_rephrase_v1_1 T5Transformer from magnifi +author: John Snow Labs +name: flan_t5_continuity_rephrase_v1_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_continuity_rephrase_v1_1` is a English model originally trained by magnifi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_continuity_rephrase_v1_1_en_5.4.2_3.0_1724468341868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_continuity_rephrase_v1_1_en_5.4.2_3.0_1724468341868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_continuity_rephrase_v1_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_continuity_rephrase_v1_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_continuity_rephrase_v1_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/magnifi/flan-t5-continuity-rephrase-v1.1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_pipeline_en.md new file mode 100644 index 00000000000000..739b8ba039ef66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_continuity_rephrase_v1_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_continuity_rephrase_v1_1_pipeline pipeline T5Transformer from magnifi +author: John Snow Labs +name: flan_t5_continuity_rephrase_v1_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_continuity_rephrase_v1_1_pipeline` is a English model originally trained by magnifi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_continuity_rephrase_v1_1_pipeline_en_5.4.2_3.0_1724468390588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_continuity_rephrase_v1_1_pipeline_en_5.4.2_3.0_1724468390588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_continuity_rephrase_v1_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_continuity_rephrase_v1_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_continuity_rephrase_v1_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/magnifi/flan-t5-continuity-rephrase-v1.1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_en.md new file mode 100644 index 00000000000000..5d1a0862a8ce58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_imdb_accelerator T5Transformer from OmarHaroon01 +author: John Snow Labs +name: flan_t5_imdb_accelerator +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_imdb_accelerator` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_imdb_accelerator_en_5.4.2_3.0_1724510526170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_imdb_accelerator_en_5.4.2_3.0_1724510526170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_imdb_accelerator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_imdb_accelerator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_imdb_accelerator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/OmarHaroon01/flan_t5_imdb_accelerator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_pipeline_en.md new file mode 100644 index 00000000000000..5e4b7096c45194 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_imdb_accelerator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_imdb_accelerator_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: flan_t5_imdb_accelerator_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_imdb_accelerator_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_imdb_accelerator_pipeline_en_5.4.2_3.0_1724510542793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_imdb_accelerator_pipeline_en_5.4.2_3.0_1724510542793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_imdb_accelerator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_imdb_accelerator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_imdb_accelerator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/OmarHaroon01/flan_t5_imdb_accelerator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_en.md new file mode 100644 index 00000000000000..1d0722d3730522 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_clang8_e1_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_clang8_e1_b16 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_clang8_e1_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e1_b16_en_5.4.2_3.0_1724521160800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e1_b16_en_5.4.2_3.0_1724521160800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_clang8_e1_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_clang8_e1_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_clang8_e1_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-clang8-e1-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_pipeline_en.md new file mode 100644 index 00000000000000..2b089b54a02460 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_clang8_e1_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_clang8_e1_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_clang8_e1_b16_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_clang8_e1_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e1_b16_pipeline_en_5.4.2_3.0_1724521387118.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e1_b16_pipeline_en_5.4.2_3.0_1724521387118.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_clang8_e1_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_clang8_e1_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_clang8_e1_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-clang8-e1-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop_en.md new file mode 100644 index 00000000000000..53410a2d92dfc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop_en_5.4.2_3.0_1724458285655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop_en_5.4.2_3.0_1724458285655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep15_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep15-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_en.md new file mode 100644 index 00000000000000..3aa3f7889240b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_800 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_800 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_800` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_en_5.4.2_3.0_1724477289094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_en_5.4.2_3.0_1724477289094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_800","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_800", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_800| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_800 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_pipeline_en.md new file mode 100644 index 00000000000000..e6d76232a93c41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_0_800_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_800_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_800_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_800_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_pipeline_en_5.4.2_3.0_1724477422738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_pipeline_en_5.4.2_3.0_1724477422738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_800_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_800_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_800_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_800 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_en.md new file mode 100644 index 00000000000000..8a8fd7167310df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_en_5.4.2_3.0_1724486116167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_en_5.4.2_3.0_1724486116167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_400-ep20-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..82731726b77b8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline_en_5.4.2_3.0_1724486251304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline_en_5.4.2_3.0_1724486251304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_400_ep20_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_400-ep20-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_en.md new file mode 100644 index 00000000000000..360692c53ed8bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_en_5.4.2_3.0_1724529812623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_en_5.4.2_3.0_1724529812623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_800-ep20-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..e5c11208eef6a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline_en_5.4.2_3.0_1724529955155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline_en_5.4.2_3.0_1724529955155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_800_ep20_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_800-ep20-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_dialogsum_samsum_v2_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_dialogsum_samsum_v2_en.md new file mode 100644 index 00000000000000..dd1020e50e93bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_dialogsum_samsum_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_dialogsum_samsum_v2 T5Transformer from Joshua-Abok +author: John Snow Labs +name: flan_t5_large_dialogsum_samsum_v2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_dialogsum_samsum_v2` is a English model originally trained by Joshua-Abok. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_dialogsum_samsum_v2_en_5.4.2_3.0_1724497942470.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_dialogsum_samsum_v2_en_5.4.2_3.0_1724497942470.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_dialogsum_samsum_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_dialogsum_samsum_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_dialogsum_samsum_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/Joshua-Abok/flan-t5-large-dialogsum_samsum_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_en.md new file mode 100644 index 00000000000000..2ea986cbc24d48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_en_5.4.2_3.0_1724485236763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_en_5.4.2_3.0_1724485236763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_en.md new file mode 100644 index 00000000000000..1963b7603c82cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_en_5.4.2_3.0_1724483780434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_en_5.4.2_3.0_1724483780434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all-hint_precision-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline_en.md new file mode 100644 index 00000000000000..5f893fbafe5d0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline_en_5.4.2_3.0_1724483919359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline_en_5.4.2_3.0_1724483919359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all_hint_precision_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all-hint_precision-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_en.md new file mode 100644 index 00000000000000..789df8a7bfb97e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_en_5.4.2_3.0_1724522544895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_en_5.4.2_3.0_1724522544895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all-new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..2b2eaa62134a60 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline_en_5.4.2_3.0_1724522685389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline_en_5.4.2_3.0_1724522685389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all-new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_pipeline_en.md new file mode 100644 index 00000000000000..0327f1872f2e07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_extraction_cnndm_4000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_4000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_4000_all_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_4000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_pipeline_en_5.4.2_3.0_1724485373551.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_4000_all_pipeline_en_5.4.2_3.0_1724485373551.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_4000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_4000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_4000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_en.md new file mode 100644 index 00000000000000..f167a5e541ecf8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_28_hierarchical_ep10 T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_28_hierarchical_ep10 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_28_hierarchical_ep10` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_hierarchical_ep10_en_5.4.2_3.0_1724513539138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_hierarchical_ep10_en_5.4.2_3.0_1724513539138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_28_hierarchical_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_28_hierarchical_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_28_hierarchical_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_28_hierarchical_ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_pipeline_en.md new file mode 100644 index 00000000000000..1772e56cab98ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_28_hierarchical_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_28_hierarchical_ep10_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_28_hierarchical_ep10_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_28_hierarchical_ep10_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_hierarchical_ep10_pipeline_en_5.4.2_3.0_1724513685270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_hierarchical_ep10_pipeline_en_5.4.2_3.0_1724513685270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_28_hierarchical_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_28_hierarchical_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_28_hierarchical_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_28_hierarchical_ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_en.md new file mode 100644 index 00000000000000..6193d2d767e1e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_encoder_rationale T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_encoder_rationale +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_encoder_rationale` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_encoder_rationale_en_5.4.2_3.0_1724542238895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_encoder_rationale_en_5.4.2_3.0_1724542238895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_encoder_rationale","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_encoder_rationale", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_encoder_rationale| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_encoder_Rationale \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_pipeline_en.md new file mode 100644 index 00000000000000..80b6dba470777b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_medistill_encoder_rationale_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_encoder_rationale_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_encoder_rationale_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_encoder_rationale_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_encoder_rationale_pipeline_en_5.4.2_3.0_1724542378054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_encoder_rationale_pipeline_en_5.4.2_3.0_1724542378054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_encoder_rationale_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_encoder_rationale_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_encoder_rationale_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_encoder_Rationale + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_en.md new file mode 100644 index 00000000000000..5ead6a1c15fd79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_squad_qag_ep6 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_squad_qag_ep6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_squad_qag_ep6` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_ep6_en_5.4.2_3.0_1724506866296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_ep6_en_5.4.2_3.0_1724506866296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_squad_qag_ep6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_squad_qag_ep6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_squad_qag_ep6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-SQuAD-qag-ep6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_pipeline_en.md new file mode 100644 index 00000000000000..75dcd7e93eced3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_large_squad_qag_ep6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_squad_qag_ep6_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_squad_qag_ep6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_squad_qag_ep6_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724507012334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724507012334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_squad_qag_ep6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_squad_qag_ep6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_squad_qag_ep6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-SQuAD-qag-ep6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_en.md new file mode 100644 index 00000000000000..d3878504ae5efe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_qa_sample T5Transformer from Binaryy +author: John Snow Labs +name: flan_t5_qa_sample +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qa_sample` is a English model originally trained by Binaryy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qa_sample_en_5.4.2_3.0_1724498637745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qa_sample_en_5.4.2_3.0_1724498637745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_qa_sample","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_qa_sample", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qa_sample| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.9 GB| + +## References + +https://huggingface.co/Binaryy/flan-t5-qa-sample \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_pipeline_en.md new file mode 100644 index 00000000000000..8236c5c8d08501 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_qa_sample_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_qa_sample_pipeline pipeline T5Transformer from Binaryy +author: John Snow Labs +name: flan_t5_qa_sample_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qa_sample_pipeline` is a English model originally trained by Binaryy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qa_sample_pipeline_en_5.4.2_3.0_1724498723431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qa_sample_pipeline_en_5.4.2_3.0_1724498723431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_qa_sample_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_qa_sample_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qa_sample_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.9 GB| + +## References + +https://huggingface.co/Binaryy/flan-t5-qa-sample + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_en.md new file mode 100644 index 00000000000000..7211fd97f0581a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_mlm_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_mlm_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_mlm_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_small_en_5.4.2_3.0_1724481070702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_small_en_5.4.2_3.0_1724481070702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_mlm_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_mlm_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_mlm_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-mlm-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_pipeline_en.md new file mode 100644 index 00000000000000..74e655fe28e4f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_retacred_kongo_mlm_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_mlm_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_mlm_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_mlm_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_small_pipeline_en_5.4.2_3.0_1724481087889.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_small_pipeline_en_5.4.2_3.0_1724481087889.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_mlm_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_mlm_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_mlm_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-mlm-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_en.md new file mode 100644 index 00000000000000..f7650a8c53c133 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_1_6_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_1_6_cnndm +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_1_6_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_6_cnndm_en_5.4.2_3.0_1724512091492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_6_cnndm_en_5.4.2_3.0_1724512091492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_1_6_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_1_6_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_1_6_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|287.9 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-1-6-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..a19cea07e13d1c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_1_6_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_1_6_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_1_6_cnndm_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_1_6_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_6_cnndm_pipeline_en_5.4.2_3.0_1724512105372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_6_cnndm_pipeline_en_5.4.2_3.0_1724512105372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_1_6_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_1_6_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_1_6_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|287.9 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-1-6-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_en.md new file mode 100644 index 00000000000000..434664747413ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_4_4_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_4_4_cnndm +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_4_4_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_4_cnndm_en_5.4.2_3.0_1724492005106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_4_cnndm_en_5.4.2_3.0_1724492005106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_4_4_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_4_4_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_4_4_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|287.9 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-4-4-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..78cac06e932635 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_4_4_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_4_4_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_4_4_cnndm_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_4_4_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_4_cnndm_pipeline_en_5.4.2_3.0_1724492018210.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_4_cnndm_pipeline_en_5.4.2_3.0_1724492018210.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_4_4_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_4_4_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_4_4_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|287.9 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-4-4-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_en.md new file mode 100644 index 00000000000000..37b8b852f20684 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f3_prompt_adherence T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f3_prompt_adherence +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f3_prompt_adherence` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f3_prompt_adherence_en_5.4.2_3.0_1724515345219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f3_prompt_adherence_en_5.4.2_3.0_1724515345219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f3_prompt_adherence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f3_prompt_adherence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f3_prompt_adherence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f3_prompt_adherence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_pipeline_en.md new file mode 100644 index 00000000000000..f98e1ca3f33227 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_asap_t3_f3_prompt_adherence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f3_prompt_adherence_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f3_prompt_adherence_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f3_prompt_adherence_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f3_prompt_adherence_pipeline_en_5.4.2_3.0_1724515361251.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f3_prompt_adherence_pipeline_en_5.4.2_3.0_1724515361251.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t3_f3_prompt_adherence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t3_f3_prompt_adherence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f3_prompt_adherence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f3_prompt_adherence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_en.md new file mode 100644 index 00000000000000..a86e3fd1dd3e8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_askscience_qg T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_small_askscience_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_askscience_qg` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_askscience_qg_en_5.4.2_3.0_1724507897558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_askscience_qg_en_5.4.2_3.0_1724507897558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_askscience_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_askscience_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_askscience_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-small_askscience-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_pipeline_en.md new file mode 100644 index 00000000000000..9c43d7691b0f09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_askscience_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_askscience_qg_pipeline pipeline T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_small_askscience_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_askscience_qg_pipeline` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_askscience_qg_pipeline_en_5.4.2_3.0_1724507913862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_askscience_qg_pipeline_en_5.4.2_3.0_1724507913862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_askscience_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_askscience_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_askscience_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-small_askscience-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_en.md new file mode 100644 index 00000000000000..185a0d0c10edf2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_conditional_translation_me_english_me T5Transformer from zuko2 +author: John Snow Labs +name: flan_t5_small_conditional_translation_me_english_me +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_conditional_translation_me_english_me` is a English model originally trained by zuko2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_conditional_translation_me_english_me_en_5.4.2_3.0_1724508583038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_conditional_translation_me_english_me_en_5.4.2_3.0_1724508583038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_conditional_translation_me_english_me","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_conditional_translation_me_english_me", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_conditional_translation_me_english_me| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/zuko2/flan-t5-small-conditional-translation-me-en-me \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_pipeline_en.md new file mode 100644 index 00000000000000..fc0a0c26c85ccc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_conditional_translation_me_english_me_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_conditional_translation_me_english_me_pipeline pipeline T5Transformer from zuko2 +author: John Snow Labs +name: flan_t5_small_conditional_translation_me_english_me_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_conditional_translation_me_english_me_pipeline` is a English model originally trained by zuko2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_conditional_translation_me_english_me_pipeline_en_5.4.2_3.0_1724508599311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_conditional_translation_me_english_me_pipeline_en_5.4.2_3.0_1724508599311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_conditional_translation_me_english_me_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_conditional_translation_me_english_me_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_conditional_translation_me_english_me_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/zuko2/flan-t5-small-conditional-translation-me-en-me + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_en.md new file mode 100644 index 00000000000000..78eb57cc8e975e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_fold_4 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_small_fold_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_fold_4` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_fold_4_en_5.4.2_3.0_1724526462617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_fold_4_en_5.4.2_3.0_1724526462617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_fold_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_fold_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_fold_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/research-dump/flan-t5-small_fold_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_pipeline_en.md new file mode 100644 index 00000000000000..16da5482e616c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_fold_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_fold_4_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_small_fold_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_fold_4_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_fold_4_pipeline_en_5.4.2_3.0_1724526478814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_fold_4_pipeline_en_5.4.2_3.0_1724526478814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_fold_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_fold_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_fold_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/research-dump/flan-t5-small_fold_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_en.md new file mode 100644 index 00000000000000..b12a4d38726ecc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_with_ppo T5Transformer from dima806 +author: John Snow Labs +name: flan_t5_small_with_ppo +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_with_ppo` is a English model originally trained by dima806. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_with_ppo_en_5.4.2_3.0_1724461027729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_with_ppo_en_5.4.2_3.0_1724461027729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_with_ppo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_with_ppo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_with_ppo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dima806/flan-t5-small-with-ppo \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_pipeline_en.md new file mode 100644 index 00000000000000..42736e335565b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_small_with_ppo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_with_ppo_pipeline pipeline T5Transformer from dima806 +author: John Snow Labs +name: flan_t5_small_with_ppo_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_with_ppo_pipeline` is a English model originally trained by dima806. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_with_ppo_pipeline_en_5.4.2_3.0_1724461046248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_with_ppo_pipeline_en_5.4.2_3.0_1724461046248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_with_ppo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_with_ppo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_with_ppo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dima806/flan-t5-small-with-ppo + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_en.md new file mode 100644 index 00000000000000..260a85efa97284 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_w_context_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_en_5.4.2_3.0_1724480368297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_en_5.4.2_3.0_1724480368297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_en.md new file mode 100644 index 00000000000000..d87ac38c0599aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_w_context_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_w_context_small_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_w_context_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_finetuned_en_5.4.2_3.0_1724532821940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_finetuned_en_5.4.2_3.0_1724532821940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_w_context_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_w_context_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_w_context_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-w-context-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..c23ac2ab3da761 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_w_context_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_w_context_small_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_w_context_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724532837799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724532837799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_tacred_kongo_w_context_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_tacred_kongo_w_context_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_w_context_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-w-context-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..28b60ed6223c25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flan_t5_tacred_kongo_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_w_context_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_pipeline_en_5.4.2_3.0_1724480384587.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_w_context_small_pipeline_en_5.4.2_3.0_1724480384587.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_tacred_kongo_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_tacred_kongo_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_en.md b/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_en.md new file mode 100644 index 00000000000000..e8a2e2602d4ec0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5base_only_translate_1000000_1epoch T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_only_translate_1000000_1epoch +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_only_translate_1000000_1epoch` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_only_translate_1000000_1epoch_en_5.4.2_3.0_1724498015629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_only_translate_1000000_1epoch_en_5.4.2_3.0_1724498015629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5base_only_translate_1000000_1epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5base_only_translate_1000000_1epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_only_translate_1000000_1epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_only_translate_1000000_1epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_pipeline_en.md new file mode 100644 index 00000000000000..3c598d59b54ff7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flant5base_only_translate_1000000_1epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5base_only_translate_1000000_1epoch_pipeline pipeline T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_only_translate_1000000_1epoch_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_only_translate_1000000_1epoch_pipeline` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_only_translate_1000000_1epoch_pipeline_en_5.4.2_3.0_1724498066648.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_only_translate_1000000_1epoch_pipeline_en_5.4.2_3.0_1724498066648.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5base_only_translate_1000000_1epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5base_only_translate_1000000_1epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_only_translate_1000000_1epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_only_translate_1000000_1epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_en.md b/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_en.md new file mode 100644 index 00000000000000..f02df7cab80fab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flirty_paraphraser T5Transformer from ieuniversity +author: John Snow Labs +name: flirty_paraphraser +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flirty_paraphraser` is a English model originally trained by ieuniversity. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flirty_paraphraser_en_5.4.2_3.0_1724500204034.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flirty_paraphraser_en_5.4.2_3.0_1724500204034.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flirty_paraphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flirty_paraphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flirty_paraphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ieuniversity/flirty_paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_pipeline_en.md new file mode 100644 index 00000000000000..fb39e8b278f983 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-flirty_paraphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flirty_paraphraser_pipeline pipeline T5Transformer from ieuniversity +author: John Snow Labs +name: flirty_paraphraser_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flirty_paraphraser_pipeline` is a English model originally trained by ieuniversity. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flirty_paraphraser_pipeline_en_5.4.2_3.0_1724500251364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flirty_paraphraser_pipeline_en_5.4.2_3.0_1724500251364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flirty_paraphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flirty_paraphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flirty_paraphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ieuniversity/flirty_paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_en.md b/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_en.md new file mode 100644 index 00000000000000..02d9efc818c853 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft5_reza_alipour T5Transformer from reza-alipour +author: John Snow Labs +name: ft5_reza_alipour +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft5_reza_alipour` is a English model originally trained by reza-alipour. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft5_reza_alipour_en_5.4.2_3.0_1724540953953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft5_reza_alipour_en_5.4.2_3.0_1724540953953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft5_reza_alipour","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft5_reza_alipour", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft5_reza_alipour| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/reza-alipour/ft5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_pipeline_en.md new file mode 100644 index 00000000000000..ec930ee7e7c6fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ft5_reza_alipour_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft5_reza_alipour_pipeline pipeline T5Transformer from reza-alipour +author: John Snow Labs +name: ft5_reza_alipour_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft5_reza_alipour_pipeline` is a English model originally trained by reza-alipour. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft5_reza_alipour_pipeline_en_5.4.2_3.0_1724541092151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft5_reza_alipour_pipeline_en_5.4.2_3.0_1724541092151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft5_reza_alipour_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft5_reza_alipour_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft5_reza_alipour_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/reza-alipour/ft5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_de.md new file mode 100644 index 00000000000000..01ce4372718d5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_longt5_base_128 T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_base_128 +date: 2024-08-24 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_base_128` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_128_de_5.4.2_3.0_1724529097700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_128_de_5.4.2_3.0_1724529097700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_longt5_base_128","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_longt5_base_128", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_base_128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-base-128 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_pipeline_de.md new file mode 100644 index 00000000000000..f88a78cfccc031 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_128_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_longt5_base_128_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_base_128_pipeline +date: 2024-08-24 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_base_128_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_128_pipeline_de_5.4.2_3.0_1724529153829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_128_pipeline_de_5.4.2_3.0_1724529153829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_longt5_base_128_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_longt5_base_128_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_base_128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-base-128 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_de.md new file mode 100644 index 00000000000000..dccf3d524e9097 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_longt5_base T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_base +date: 2024-08-24 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_base` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_de_5.4.2_3.0_1724472617732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_de_5.4.2_3.0_1724472617732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_longt5_base","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_longt5_base", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_pipeline_de.md new file mode 100644 index 00000000000000..38ebe9787b6899 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_longt5_base_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_longt5_base_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_base_pipeline +date: 2024-08-24 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_base_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_pipeline_de_5.4.2_3.0_1724472665807.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_base_pipeline_de_5.4.2_3.0_1724472665807.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_longt5_base_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_longt5_base_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_de.md new file mode 100644 index 00000000000000..de107e4380430d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_mt5_base T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_mt5_base +date: 2024-08-24 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_mt5_base` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_mt5_base_de_5.4.2_3.0_1724507312004.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_mt5_base_de_5.4.2_3.0_1724507312004.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_mt5_base","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_mt5_base", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|2.3 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_pipeline_de.md new file mode 100644 index 00000000000000..412a85d868217c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-german_jeopardy_mt5_base_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_mt5_base_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_mt5_base_pipeline +date: 2024-08-24 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_mt5_base_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_mt5_base_pipeline_de_5.4.2_3.0_1724507591037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_mt5_base_pipeline_de_5.4.2_3.0_1724507591037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_mt5_base_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_mt5_base_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_mt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|2.3 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_en.md b/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_en.md new file mode 100644 index 00000000000000..e75c620e3d6672 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English google_t5_small_english_spanish_fine_tune_opus100 T5Transformer from beanslmao +author: John Snow Labs +name: google_t5_small_english_spanish_fine_tune_opus100 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_t5_small_english_spanish_fine_tune_opus100` is a English model originally trained by beanslmao. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_t5_small_english_spanish_fine_tune_opus100_en_5.4.2_3.0_1724505857689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_t5_small_english_spanish_fine_tune_opus100_en_5.4.2_3.0_1724505857689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("google_t5_small_english_spanish_fine_tune_opus100","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("google_t5_small_english_spanish_fine_tune_opus100", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_t5_small_english_spanish_fine_tune_opus100| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.9 MB| + +## References + +https://huggingface.co/beanslmao/google-t5-small-en-es-fine-tune-opus100 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_pipeline_en.md new file mode 100644 index 00000000000000..35970e3f36b2fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-google_t5_small_english_spanish_fine_tune_opus100_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English google_t5_small_english_spanish_fine_tune_opus100_pipeline pipeline T5Transformer from beanslmao +author: John Snow Labs +name: google_t5_small_english_spanish_fine_tune_opus100_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_t5_small_english_spanish_fine_tune_opus100_pipeline` is a English model originally trained by beanslmao. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_t5_small_english_spanish_fine_tune_opus100_pipeline_en_5.4.2_3.0_1724505875231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_t5_small_english_spanish_fine_tune_opus100_pipeline_en_5.4.2_3.0_1724505875231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("google_t5_small_english_spanish_fine_tune_opus100_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("google_t5_small_english_spanish_fine_tune_opus100_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_t5_small_english_spanish_fine_tune_opus100_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.9 MB| + +## References + +https://huggingface.co/beanslmao/google-t5-small-en-es-fine-tune-opus100 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_en.md b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_en.md new file mode 100644 index 00000000000000..c1c6996bd80ba7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_correction_achrekarom T5Transformer from achrekarom +author: John Snow Labs +name: grammar_correction_achrekarom +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_correction_achrekarom` is a English model originally trained by achrekarom. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_correction_achrekarom_en_5.4.2_3.0_1724475020310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_correction_achrekarom_en_5.4.2_3.0_1724475020310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_correction_achrekarom","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_correction_achrekarom", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_correction_achrekarom| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|970.2 MB| + +## References + +https://huggingface.co/achrekarom/grammar_correction \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_pipeline_en.md new file mode 100644 index 00000000000000..8b5ef23c614627 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_achrekarom_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_correction_achrekarom_pipeline pipeline T5Transformer from achrekarom +author: John Snow Labs +name: grammar_correction_achrekarom_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_correction_achrekarom_pipeline` is a English model originally trained by achrekarom. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_correction_achrekarom_pipeline_en_5.4.2_3.0_1724475077871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_correction_achrekarom_pipeline_en_5.4.2_3.0_1724475077871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_correction_achrekarom_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_correction_achrekarom_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_correction_achrekarom_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|970.2 MB| + +## References + +https://huggingface.co/achrekarom/grammar_correction + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_en.md b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_en.md new file mode 100644 index 00000000000000..da1c24b2fccaf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_correction_t5 T5Transformer from Tarunkumar8 +author: John Snow Labs +name: grammar_correction_t5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_correction_t5` is a English model originally trained by Tarunkumar8. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_correction_t5_en_5.4.2_3.0_1724486046489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_correction_t5_en_5.4.2_3.0_1724486046489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_correction_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_correction_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_correction_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tarunkumar8/Grammar_Correction_T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_pipeline_en.md new file mode 100644 index 00000000000000..30a3e616e488c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-grammar_correction_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_correction_t5_pipeline pipeline T5Transformer from Tarunkumar8 +author: John Snow Labs +name: grammar_correction_t5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_correction_t5_pipeline` is a English model originally trained by Tarunkumar8. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_correction_t5_pipeline_en_5.4.2_3.0_1724486095600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_correction_t5_pipeline_en_5.4.2_3.0_1724486095600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_correction_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_correction_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_correction_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tarunkumar8/Grammar_Correction_T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_en.md b/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_en.md new file mode 100644 index 00000000000000..69850e50906e53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gupshup_e2e_t5_ad6398 T5Transformer from ad6398 +author: John Snow Labs +name: gupshup_e2e_t5_ad6398 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gupshup_e2e_t5_ad6398` is a English model originally trained by ad6398. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gupshup_e2e_t5_ad6398_en_5.4.2_3.0_1724469487368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gupshup_e2e_t5_ad6398_en_5.4.2_3.0_1724469487368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gupshup_e2e_t5_ad6398","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gupshup_e2e_t5_ad6398", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gupshup_e2e_t5_ad6398| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/ad6398/gupshup_e2e_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_pipeline_en.md new file mode 100644 index 00000000000000..37260b68e11cc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-gupshup_e2e_t5_ad6398_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gupshup_e2e_t5_ad6398_pipeline pipeline T5Transformer from ad6398 +author: John Snow Labs +name: gupshup_e2e_t5_ad6398_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gupshup_e2e_t5_ad6398_pipeline` is a English model originally trained by ad6398. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gupshup_e2e_t5_ad6398_pipeline_en_5.4.2_3.0_1724469570621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gupshup_e2e_t5_ad6398_pipeline_en_5.4.2_3.0_1724469570621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gupshup_e2e_t5_ad6398_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gupshup_e2e_t5_ad6398_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gupshup_e2e_t5_ad6398_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/ad6398/gupshup_e2e_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_en.md b/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_en.md new file mode 100644 index 00000000000000..7ec9288a2929ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gupshup_h2e_t5_mtl T5Transformer from midas +author: John Snow Labs +name: gupshup_h2e_t5_mtl +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gupshup_h2e_t5_mtl` is a English model originally trained by midas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gupshup_h2e_t5_mtl_en_5.4.2_3.0_1724467073667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gupshup_h2e_t5_mtl_en_5.4.2_3.0_1724467073667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gupshup_h2e_t5_mtl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gupshup_h2e_t5_mtl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gupshup_h2e_t5_mtl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.4 MB| + +## References + +https://huggingface.co/midas/gupshup_h2e_t5_mtl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_pipeline_en.md new file mode 100644 index 00000000000000..a348906ee6fdb0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-gupshup_h2e_t5_mtl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gupshup_h2e_t5_mtl_pipeline pipeline T5Transformer from midas +author: John Snow Labs +name: gupshup_h2e_t5_mtl_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gupshup_h2e_t5_mtl_pipeline` is a English model originally trained by midas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gupshup_h2e_t5_mtl_pipeline_en_5.4.2_3.0_1724467156469.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gupshup_h2e_t5_mtl_pipeline_en_5.4.2_3.0_1724467156469.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gupshup_h2e_t5_mtl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gupshup_h2e_t5_mtl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gupshup_h2e_t5_mtl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.4 MB| + +## References + +https://huggingface.co/midas/gupshup_h2e_t5_mtl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_en.md b/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_en.md new file mode 100644 index 00000000000000..66c8bd1e14f6a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English hat5_augmentation T5Transformer from sana-ngu +author: John Snow Labs +name: hat5_augmentation +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hat5_augmentation` is a English model originally trained by sana-ngu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hat5_augmentation_en_5.4.2_3.0_1724508054810.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hat5_augmentation_en_5.4.2_3.0_1724508054810.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("hat5_augmentation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("hat5_augmentation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hat5_augmentation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.7 MB| + +## References + +https://huggingface.co/sana-ngu/HaT5_augmentation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_pipeline_en.md new file mode 100644 index 00000000000000..073bf6eda6af56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-hat5_augmentation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hat5_augmentation_pipeline pipeline T5Transformer from sana-ngu +author: John Snow Labs +name: hat5_augmentation_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hat5_augmentation_pipeline` is a English model originally trained by sana-ngu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hat5_augmentation_pipeline_en_5.4.2_3.0_1724508114650.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hat5_augmentation_pipeline_en_5.4.2_3.0_1724508114650.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hat5_augmentation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hat5_augmentation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hat5_augmentation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.7 MB| + +## References + +https://huggingface.co/sana-ngu/HaT5_augmentation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_en.md new file mode 100644 index 00000000000000..5a32ae9ccdea47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_en.md @@ -0,0 +1,92 @@ +--- +layout: model +title: English hinglish_finetuned BertEmbeddings from ketan-rmcf +author: John Snow Labs +name: hinglish_finetuned +date: 2024-08-24 +tags: [bert, en, open_source, fill_mask, onnx] +task: Embeddings +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained BertEmbeddings model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hinglish_finetuned` is a English model originally trained by ketan-rmcf. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hinglish_finetuned_en_5.4.2_3.0_1724487646252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hinglish_finetuned_en_5.4.2_3.0_1724487646252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +document_assembler = DocumentAssembler() \ + .setInputCol("text") \ + .setOutputCol("documents") + + +embeddings =BertEmbeddings.pretrained("hinglish_finetuned","en") \ + .setInputCols(["documents","token"]) \ + .setOutputCol("embeddings") + +pipeline = Pipeline().setStages([document_assembler, embeddings]) + +pipelineModel = pipeline.fit(data) + +pipelineDF = pipelineModel.transform(data) +``` +```scala +val document_assembler = new DocumentAssembler() + .setInputCol("text") + .setOutputCol("embeddings") + +val embeddings = BertEmbeddings + .pretrained("hinglish_finetuned", "en") + .setInputCols(Array("documents","token")) + .setOutputCol("embeddings") + +val pipeline = new Pipeline().setStages(Array(document_assembler, embeddings)) + +val pipelineModel = pipeline.fit(data) + +val pipelineDF = pipelineModel.transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hinglish_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +References + +https://huggingface.co/ketan-rmcf/hinglish-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..82b5f334ba33f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-hinglish_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hinglish_finetuned_pipeline pipeline T5Transformer from VasRosa +author: John Snow Labs +name: hinglish_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hinglish_finetuned_pipeline` is a English model originally trained by VasRosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hinglish_finetuned_pipeline_en_5.4.2_3.0_1724487700031.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hinglish_finetuned_pipeline_en_5.4.2_3.0_1724487700031.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hinglish_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hinglish_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hinglish_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/VasRosa/Hinglish-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_en.md new file mode 100644 index 00000000000000..5d2d7a21a181cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English imdb_t5_small_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_small_seed_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_small_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_1_en_5.4.2_3.0_1724511805424.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_1_en_5.4.2_3.0_1724511805424.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("imdb_t5_small_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("imdb_t5_small_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_small_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-small_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..4b43a1a42249cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-imdb_t5_small_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English imdb_t5_small_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_small_seed_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_small_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724511826655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724511826655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("imdb_t5_small_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("imdb_t5_small_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_small_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-small_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_en.md b/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_en.md new file mode 100644 index 00000000000000..8928b0a5f07577 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English informal_tonga_tonga_islands_formal_isotonic T5Transformer from Isotonic +author: John Snow Labs +name: informal_tonga_tonga_islands_formal_isotonic +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`informal_tonga_tonga_islands_formal_isotonic` is a English model originally trained by Isotonic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/informal_tonga_tonga_islands_formal_isotonic_en_5.4.2_3.0_1724464744299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/informal_tonga_tonga_islands_formal_isotonic_en_5.4.2_3.0_1724464744299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("informal_tonga_tonga_islands_formal_isotonic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("informal_tonga_tonga_islands_formal_isotonic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|informal_tonga_tonga_islands_formal_isotonic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Isotonic/informal_to_formal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_pipeline_en.md new file mode 100644 index 00000000000000..47c5c2bbf2eff0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-informal_tonga_tonga_islands_formal_isotonic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English informal_tonga_tonga_islands_formal_isotonic_pipeline pipeline T5Transformer from Isotonic +author: John Snow Labs +name: informal_tonga_tonga_islands_formal_isotonic_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`informal_tonga_tonga_islands_formal_isotonic_pipeline` is a English model originally trained by Isotonic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/informal_tonga_tonga_islands_formal_isotonic_pipeline_en_5.4.2_3.0_1724464887901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/informal_tonga_tonga_islands_formal_isotonic_pipeline_en_5.4.2_3.0_1724464887901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("informal_tonga_tonga_islands_formal_isotonic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("informal_tonga_tonga_islands_formal_isotonic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|informal_tonga_tonga_islands_formal_isotonic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Isotonic/informal_to_formal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_en.md b/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_en.md new file mode 100644 index 00000000000000..587eb053564815 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English it5_efficient_small_el32 T5Transformer from stefan-it +author: John Snow Labs +name: it5_efficient_small_el32 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32` is a English model originally trained by stefan-it. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_en_5.4.2_3.0_1724461722519.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_en_5.4.2_3.0_1724461722519.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("it5_efficient_small_el32","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("it5_efficient_small_el32", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/stefan-it/it5-efficient-small-el32 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_pipeline_en.md new file mode 100644 index 00000000000000..aac5ba7d2dc35f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-it5_efficient_small_el32_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English it5_efficient_small_el32_pipeline pipeline T5Transformer from stefan-it +author: John Snow Labs +name: it5_efficient_small_el32_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32_pipeline` is a English model originally trained by stefan-it. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_pipeline_en_5.4.2_3.0_1724461835019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_pipeline_en_5.4.2_3.0_1724461835019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("it5_efficient_small_el32_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("it5_efficient_small_el32_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/stefan-it/it5-efficient-small-el32 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_en.md new file mode 100644 index 00000000000000..308bf3b3cd5fee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_3_msrvtt_2 T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_msrvtt_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_msrvtt_2` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_2_en_5.4.2_3.0_1724493317098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_2_en_5.4.2_3.0_1724493317098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_3_msrvtt_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_3_msrvtt_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_msrvtt_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.7 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_msrvtt_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_pipeline_en.md new file mode 100644 index 00000000000000..ca24b379cf04d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-k2t_3_msrvtt_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_3_msrvtt_2_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_msrvtt_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_msrvtt_2_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_2_pipeline_en_5.4.2_3.0_1724493338331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_2_pipeline_en_5.4.2_3.0_1724493338331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_3_msrvtt_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_3_msrvtt_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_msrvtt_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.7 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_msrvtt_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_en.md b/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_en.md new file mode 100644 index 00000000000000..f7c5d91a69af16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kingjamesify_t5_base_lm_adapt T5Transformer from swcrazyfan +author: John Snow Labs +name: kingjamesify_t5_base_lm_adapt +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kingjamesify_t5_base_lm_adapt` is a English model originally trained by swcrazyfan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kingjamesify_t5_base_lm_adapt_en_5.4.2_3.0_1724493783379.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kingjamesify_t5_base_lm_adapt_en_5.4.2_3.0_1724493783379.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kingjamesify_t5_base_lm_adapt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kingjamesify_t5_base_lm_adapt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kingjamesify_t5_base_lm_adapt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|967.2 MB| + +## References + +https://huggingface.co/swcrazyfan/KingJamesify-T5-base-lm-adapt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_pipeline_en.md new file mode 100644 index 00000000000000..edf7222c8beb20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kingjamesify_t5_base_lm_adapt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kingjamesify_t5_base_lm_adapt_pipeline pipeline T5Transformer from swcrazyfan +author: John Snow Labs +name: kingjamesify_t5_base_lm_adapt_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kingjamesify_t5_base_lm_adapt_pipeline` is a English model originally trained by swcrazyfan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kingjamesify_t5_base_lm_adapt_pipeline_en_5.4.2_3.0_1724493843824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kingjamesify_t5_base_lm_adapt_pipeline_en_5.4.2_3.0_1724493843824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kingjamesify_t5_base_lm_adapt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kingjamesify_t5_base_lm_adapt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kingjamesify_t5_base_lm_adapt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|967.2 MB| + +## References + +https://huggingface.co/swcrazyfan/KingJamesify-T5-base-lm-adapt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_aospl_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_aospl_en.md new file mode 100644 index 00000000000000..e7cc14abfeeec1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_aospl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_aospl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aospl +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aospl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aospl_en_5.4.2_3.0_1724510511802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aospl_en_5.4.2_3.0_1724510511802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_aospl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_aospl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aospl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_AOSPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_en.md new file mode 100644 index 00000000000000..ec224745d83371 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_apsol_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_apsol_v4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_apsol_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_v4_en_5.4.2_3.0_1724514160760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_v4_en_5.4.2_3.0_1724514160760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_apsol_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_apsol_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_apsol_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APSOL_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_pipeline_en.md new file mode 100644 index 00000000000000..049fdd6460c2a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_apsol_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_apsol_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_apsol_v4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_apsol_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_v4_pipeline_en_5.4.2_3.0_1724514327083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_v4_pipeline_en_5.4.2_3.0_1724514327083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_apsol_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_apsol_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_apsol_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APSOL_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_en.md new file mode 100644 index 00000000000000..45aac009292295 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_asopl_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_asopl_v5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_asopl_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_asopl_v5_en_5.4.2_3.0_1724497403748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_asopl_v5_en_5.4.2_3.0_1724497403748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_asopl_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_asopl_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_asopl_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_ASOPL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_pipeline_en.md new file mode 100644 index 00000000000000..2121875edac9b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_asopl_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_asopl_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_asopl_v5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_asopl_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_asopl_v5_pipeline_en_5.4.2_3.0_1724497587868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_asopl_v5_pipeline_en_5.4.2_3.0_1724497587868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_asopl_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_asopl_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_asopl_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_ASOPL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_paosl_v3_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_paosl_v3_en.md new file mode 100644 index 00000000000000..12cf8315bbc666 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_paosl_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_paosl_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_paosl_v3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_paosl_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_paosl_v3_en_5.4.2_3.0_1724458274736.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_paosl_v3_en_5.4.2_3.0_1724458274736.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_paosl_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_paosl_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_paosl_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PAOSL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_en.md new file mode 100644 index 00000000000000..d6a4cba3710346 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_poasl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_poasl +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_poasl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_en_5.4.2_3.0_1724501005454.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_en_5.4.2_3.0_1724501005454.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_poasl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_poasl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_poasl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POASL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_pipeline_en.md new file mode 100644 index 00000000000000..bea5b581a86fb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_poasl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_poasl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_poasl_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_poasl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_pipeline_en_5.4.2_3.0_1724501178026.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_poasl_pipeline_en_5.4.2_3.0_1724501178026.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_poasl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_poasl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_poasl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POASL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_en.md new file mode 100644 index 00000000000000..cbf86a7f62fcb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_posal T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_posal +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_posal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_en_5.4.2_3.0_1724529857916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_en_5.4.2_3.0_1724529857916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_posal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POSAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_pipeline_en.md new file mode 100644 index 00000000000000..d121dcc3fc18e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_posal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_posal_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_posal_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_posal_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_pipeline_en_5.4.2_3.0_1724530031277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_pipeline_en_5.4.2_3.0_1724530031277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_posal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_posal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_posal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POSAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_en.md new file mode 100644 index 00000000000000..060e9bfb5b4d0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_saopl_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_saopl_v2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_saopl_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_saopl_v2_en_5.4.2_3.0_1724485804576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_saopl_v2_en_5.4.2_3.0_1724485804576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_saopl_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_saopl_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_saopl_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SAOPL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_pipeline_en.md new file mode 100644 index 00000000000000..4e4f73e51349e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_saopl_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_saopl_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_saopl_v2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_saopl_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_saopl_v2_pipeline_en_5.4.2_3.0_1724485975975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_saopl_v2_pipeline_en_5.4.2_3.0_1724485975975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_saopl_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_saopl_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_saopl_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SAOPL_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_en.md new file mode 100644 index 00000000000000..8c5855d25ad31c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_sapol T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sapol +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sapol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sapol_en_5.4.2_3.0_1724533272650.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sapol_en_5.4.2_3.0_1724533272650.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_sapol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_sapol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sapol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SAPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_pipeline_en.md new file mode 100644 index 00000000000000..a7a7a5dbd3147a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sapol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_sapol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sapol_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sapol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sapol_pipeline_en_5.4.2_3.0_1724533493074.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sapol_pipeline_en_5.4.2_3.0_1724533493074.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_sapol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_sapol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sapol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SAPOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_en.md new file mode 100644 index 00000000000000..8c6c7d28b58673 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_sopal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sopal_v3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sopal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_v3_en_5.4.2_3.0_1724495413195.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_v3_en_5.4.2_3.0_1724495413195.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_sopal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_sopal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sopal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOPAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_pipeline_en.md new file mode 100644 index 00000000000000..40fef296c4e27d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_sopal_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_sopal_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sopal_v3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sopal_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_v3_pipeline_en_5.4.2_3.0_1724495587599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_v3_pipeline_en_5.4.2_3.0_1724495587599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_sopal_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_sopal_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sopal_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOPAL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_en.md new file mode 100644 index 00000000000000..170c8fe70ecd26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_spaol_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_spaol_v3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_spaol_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spaol_v3_en_5.4.2_3.0_1724515933759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spaol_v3_en_5.4.2_3.0_1724515933759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_spaol_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_spaol_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_spaol_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SPAOL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_pipeline_en.md new file mode 100644 index 00000000000000..06f3ff3c679b05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_spaol_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_spaol_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_spaol_v3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_spaol_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spaol_v3_pipeline_en_5.4.2_3.0_1724516107822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spaol_v3_pipeline_en_5.4.2_3.0_1724516107822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_spaol_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_spaol_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_spaol_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SPAOL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_aspol_test_rs_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_aspol_test_rs_northern_sami_en.md new file mode 100644 index 00000000000000..95101612a80f4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_aspol_test_rs_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_aspol_test_rs_northern_sami T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_aspol_test_rs_northern_sami +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_aspol_test_rs_northern_sami` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_test_rs_northern_sami_en_5.4.2_3.0_1724539667721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_test_rs_northern_sami_en_5.4.2_3.0_1724539667721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_test_rs_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_test_rs_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_aspol_test_rs_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASPOL_test_RS_SE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_en.md new file mode 100644 index 00000000000000..63deb09d177a30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_pasol_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_pasol_v2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_pasol_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v2_en_5.4.2_3.0_1724539657370.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v2_en_5.4.2_3.0_1724539657370.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_pasol_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_pasol_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_pasol_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PASOL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_pipeline_en.md new file mode 100644 index 00000000000000..fb0c19b8fbcae8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_coqe_vit5_total_pasol_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_pasol_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_pasol_v2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_pasol_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v2_pipeline_en_5.4.2_3.0_1724539821320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_pasol_v2_pipeline_en_5.4.2_3.0_1724539821320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_pasol_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_pasol_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_pasol_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PASOL_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_nan.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_nan.md new file mode 100644 index 00000000000000..3f02171da0b93f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_nan.md @@ -0,0 +1,86 @@ +--- +layout: model +title: None kltn_uni_coqe_vit5_total_aspol_v1 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_uni_coqe_vit5_total_aspol_v1 +date: 2024-08-24 +tags: [nan, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_uni_coqe_vit5_total_aspol_v1` is a None model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_uni_coqe_vit5_total_aspol_v1_nan_5.4.2_3.0_1724463035553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_uni_coqe_vit5_total_aspol_v1_nan_5.4.2_3.0_1724463035553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_uni_coqe_vit5_total_aspol_v1","nan") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_uni_coqe_vit5_total_aspol_v1", "nan") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_uni_coqe_vit5_total_aspol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nan| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_Uni_COQE_viT5_total_ASPOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_pipeline_nan.md b/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_pipeline_nan.md new file mode 100644 index 00000000000000..18da1fbea2986f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kltn_uni_coqe_vit5_total_aspol_v1_pipeline_nan.md @@ -0,0 +1,69 @@ +--- +layout: model +title: None kltn_uni_coqe_vit5_total_aspol_v1_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_uni_coqe_vit5_total_aspol_v1_pipeline +date: 2024-08-24 +tags: [nan, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_uni_coqe_vit5_total_aspol_v1_pipeline` is a None model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_uni_coqe_vit5_total_aspol_v1_pipeline_nan_5.4.2_3.0_1724463206662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_uni_coqe_vit5_total_aspol_v1_pipeline_nan_5.4.2_3.0_1724463206662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_uni_coqe_vit5_total_aspol_v1_pipeline", lang = "nan") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_uni_coqe_vit5_total_aspol_v1_pipeline", lang = "nan") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_uni_coqe_vit5_total_aspol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nan| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_Uni_COQE_viT5_total_ASPOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_ja.md b/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_ja.md new file mode 100644 index 00000000000000..2b6d55945e2a69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese kogi_mt5_test T5Transformer from kkuramitsu +author: John Snow Labs +name: kogi_mt5_test +date: 2024-08-24 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kogi_mt5_test` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kogi_mt5_test_ja_5.4.2_3.0_1724464303827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kogi_mt5_test_ja_5.4.2_3.0_1724464303827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kogi_mt5_test","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kogi_mt5_test", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kogi_mt5_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kkuramitsu/kogi-mt5-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_pipeline_ja.md new file mode 100644 index 00000000000000..0ed179cc939e81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-kogi_mt5_test_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese kogi_mt5_test_pipeline pipeline T5Transformer from kkuramitsu +author: John Snow Labs +name: kogi_mt5_test_pipeline +date: 2024-08-24 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kogi_mt5_test_pipeline` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kogi_mt5_test_pipeline_ja_5.4.2_3.0_1724464498320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kogi_mt5_test_pipeline_ja_5.4.2_3.0_1724464498320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kogi_mt5_test_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kogi_mt5_test_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kogi_mt5_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kkuramitsu/kogi-mt5-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_en.md b/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_en.md new file mode 100644 index 00000000000000..6c9667c3dd350c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lamini_flan_t5_248m_aditya7864 T5Transformer from Aditya7864 +author: John Snow Labs +name: lamini_flan_t5_248m_aditya7864 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lamini_flan_t5_248m_aditya7864` is a English model originally trained by Aditya7864. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_aditya7864_en_5.4.2_3.0_1724528373234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_aditya7864_en_5.4.2_3.0_1724528373234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lamini_flan_t5_248m_aditya7864","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lamini_flan_t5_248m_aditya7864", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lamini_flan_t5_248m_aditya7864| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Aditya7864/LaMini-Flan-T5-248M \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_pipeline_en.md new file mode 100644 index 00000000000000..998e4c091d9fbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-lamini_flan_t5_248m_aditya7864_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lamini_flan_t5_248m_aditya7864_pipeline pipeline T5Transformer from Aditya7864 +author: John Snow Labs +name: lamini_flan_t5_248m_aditya7864_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lamini_flan_t5_248m_aditya7864_pipeline` is a English model originally trained by Aditya7864. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_aditya7864_pipeline_en_5.4.2_3.0_1724528418262.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_aditya7864_pipeline_en_5.4.2_3.0_1724528418262.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lamini_flan_t5_248m_aditya7864_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lamini_flan_t5_248m_aditya7864_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lamini_flan_t5_248m_aditya7864_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Aditya7864/LaMini-Flan-T5-248M + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-latext5_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-24-latext5_pipeline_ru.md new file mode 100644 index 00000000000000..ffc21fcddc305a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-latext5_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian latext5_pipeline pipeline T5Transformer from turnipseason +author: John Snow Labs +name: latext5_pipeline +date: 2024-08-24 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`latext5_pipeline` is a Russian model originally trained by turnipseason. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/latext5_pipeline_ru_5.4.2_3.0_1724469406541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/latext5_pipeline_ru_5.4.2_3.0_1724469406541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("latext5_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("latext5_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|latext5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|277.3 MB| + +## References + +https://huggingface.co/turnipseason/latext5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-latext5_ru.md b/docs/_posts/ahmedlone127/2024-08-24-latext5_ru.md new file mode 100644 index 00000000000000..ebcb040eb7acb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-latext5_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian latext5 T5Transformer from turnipseason +author: John Snow Labs +name: latext5 +date: 2024-08-24 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`latext5` is a Russian model originally trained by turnipseason. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/latext5_ru_5.4.2_3.0_1724469392280.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/latext5_ru_5.4.2_3.0_1724469392280.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("latext5","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("latext5", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|latext5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|277.3 MB| + +## References + +https://huggingface.co/turnipseason/latext5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_en.md new file mode 100644 index 00000000000000..7ecb223b168d03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_swedish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_swedish +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_swedish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_swedish_en_5.4.2_3.0_1724491173897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_swedish_en_5.4.2_3.0_1724491173897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_swedish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_swedish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_swedish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_sv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_pipeline_en.md new file mode 100644 index 00000000000000..3da54e09ff6d20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_cls_finetuned_swedish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_swedish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_swedish_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_swedish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_swedish_pipeline_en_5.4.2_3.0_1724491234228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_swedish_pipeline_en_5.4.2_3.0_1724491234228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_finetuned_swedish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_finetuned_swedish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_swedish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_sv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_en.md new file mode 100644 index 00000000000000..0c94b5cb5c04fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_french +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_french_en_5.4.2_3.0_1724483174884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_french_en_5.4.2_3.0_1724483174884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_pipeline_en.md new file mode 100644 index 00000000000000..17bdc5545cfbd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_french_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_french_pipeline_en_5.4.2_3.0_1724483234612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_french_pipeline_en_5.4.2_3.0_1724483234612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_english_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_english_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_en.md new file mode 100644 index 00000000000000..8f237651335482 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_spanish +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_spanish_en_5.4.2_3.0_1724493843876.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_spanish_en_5.4.2_3.0_1724493843876.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_pipeline_en.md new file mode 100644 index 00000000000000..742e17f1a1addc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_english_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_spanish_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_spanish_pipeline_en_5.4.2_3.0_1724493903399.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_spanish_pipeline_en_5.4.2_3.0_1724493903399.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_english_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_english_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_german_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_german_italian_pipeline_en.md new file mode 100644 index 00000000000000..d40c2f888cc811 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_multitask_german_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_german_italian_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_german_italian_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_german_italian_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_italian_pipeline_en_5.4.2_3.0_1724457614385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_italian_pipeline_en_5.4.2_3.0_1724457614385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_german_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_german_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_german_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_de_it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_en.md new file mode 100644 index 00000000000000..43d841ab00e514 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_english_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_english_small_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_english_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_english_small_finetuned_en_5.4.2_3.0_1724476969847.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_english_small_finetuned_en_5.4.2_3.0_1724476969847.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_english_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_english_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_english_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_en_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..7f07f64d693736 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_czech_english_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_english_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_english_small_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_english_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_english_small_finetuned_pipeline_en_5.4.2_3.0_1724477028776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_english_small_finetuned_pipeline_en_5.4.2_3.0_1724477028776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_czech_english_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_czech_english_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_english_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_en_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_en.md new file mode 100644 index 00000000000000..0aea3eff9505da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_french +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_french_en_5.4.2_3.0_1724491752164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_french_en_5.4.2_3.0_1724491752164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_pipeline_en.md new file mode 100644 index 00000000000000..b8e7f42500f063 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_italian_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_french_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_french_pipeline_en_5.4.2_3.0_1724491809872.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_french_pipeline_en_5.4.2_3.0_1724491809872.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_italian_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_italian_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_en.md new file mode 100644 index 00000000000000..94c3349030145f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_german_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_german_small_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_german_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_small_finetuned_en_5.4.2_3.0_1724496823288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_small_finetuned_en_5.4.2_3.0_1724496823288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_german_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_german_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_german_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_de_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..529a567394c6cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_spanish_german_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_german_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_german_small_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_german_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_small_finetuned_pipeline_en_5.4.2_3.0_1724496882697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_small_finetuned_pipeline_en_5.4.2_3.0_1724496882697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_spanish_german_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_spanish_german_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_german_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_de_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_en.md new file mode 100644 index 00000000000000..ef345b519cf5b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_french +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_en_5.4.2_3.0_1724471934516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_en_5.4.2_3.0_1724471934516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_pipeline_en.md new file mode 100644 index 00000000000000..85d5649bbada97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_french_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_pipeline_en_5.4.2_3.0_1724471994477.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_pipeline_en_5.4.2_3.0_1724471994477.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_swedish_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_swedish_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_en.md new file mode 100644 index 00000000000000..7e2f3f12cd1f4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_french_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_french_small_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_french_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_small_finetuned_en_5.4.2_3.0_1724504442823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_small_finetuned_en_5.4.2_3.0_1724504442823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_french_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_french_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_french_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_fr_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..ef95d6ea2b09d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-legal_t5_small_trans_swedish_french_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_french_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_french_small_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_french_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_small_finetuned_pipeline_en_5.4.2_3.0_1724504502289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_french_small_finetuned_pipeline_en_5.4.2_3.0_1724504502289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_swedish_french_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_swedish_french_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_french_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_fr_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_en.md b/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_en.md new file mode 100644 index 00000000000000..45118b685589dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_local_base_abdelrahmanessmat T5Transformer from AbdelrahmanEssmat +author: John Snow Labs +name: long_t5_local_base_abdelrahmanessmat +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_abdelrahmanessmat` is a English model originally trained by AbdelrahmanEssmat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_abdelrahmanessmat_en_5.4.2_3.0_1724530098064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_abdelrahmanessmat_en_5.4.2_3.0_1724530098064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_local_base_abdelrahmanessmat","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_local_base_abdelrahmanessmat", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_abdelrahmanessmat| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.5 MB| + +## References + +https://huggingface.co/AbdelrahmanEssmat/long-t5-local-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_pipeline_en.md new file mode 100644 index 00000000000000..4ea9544bce09e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-long_t5_local_base_abdelrahmanessmat_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_local_base_abdelrahmanessmat_pipeline pipeline T5Transformer from AbdelrahmanEssmat +author: John Snow Labs +name: long_t5_local_base_abdelrahmanessmat_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_abdelrahmanessmat_pipeline` is a English model originally trained by AbdelrahmanEssmat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_abdelrahmanessmat_pipeline_en_5.4.2_3.0_1724530148555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_abdelrahmanessmat_pipeline_en_5.4.2_3.0_1724530148555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_local_base_abdelrahmanessmat_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_local_base_abdelrahmanessmat_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_abdelrahmanessmat_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.5 MB| + +## References + +https://huggingface.co/AbdelrahmanEssmat/long-t5-local-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_en.md b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_en.md new file mode 100644 index 00000000000000..95d9e34460e327 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English md_mt5_1511_v9 T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1511_v9 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1511_v9` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1511_v9_en_5.4.2_3.0_1724518736512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1511_v9_en_5.4.2_3.0_1724518736512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("md_mt5_1511_v9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("md_mt5_1511_v9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1511_v9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1511_v9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_pipeline_en.md new file mode 100644 index 00000000000000..a636f8abb0ff00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_1511_v9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English md_mt5_1511_v9_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1511_v9_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1511_v9_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1511_v9_pipeline_en_5.4.2_3.0_1724518886081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1511_v9_pipeline_en_5.4.2_3.0_1724518886081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("md_mt5_1511_v9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("md_mt5_1511_v9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1511_v9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1511_v9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_en.md b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_en.md new file mode 100644 index 00000000000000..19b55cf8cf9727 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English md_mt5_base_boun_split_first_v2 T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_base_boun_split_first_v2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_base_boun_split_first_v2` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_base_boun_split_first_v2_en_5.4.2_3.0_1724488737032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_base_boun_split_first_v2_en_5.4.2_3.0_1724488737032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("md_mt5_base_boun_split_first_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("md_mt5_base_boun_split_first_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_base_boun_split_first_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_base_boun_split_first_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_pipeline_en.md new file mode 100644 index 00000000000000..c07be1f3eac960 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-md_mt5_base_boun_split_first_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English md_mt5_base_boun_split_first_v2_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_base_boun_split_first_v2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_base_boun_split_first_v2_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_base_boun_split_first_v2_pipeline_en_5.4.2_3.0_1724488890181.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_base_boun_split_first_v2_pipeline_en_5.4.2_3.0_1724488890181.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("md_mt5_base_boun_split_first_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("md_mt5_base_boun_split_first_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_base_boun_split_first_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_base_boun_split_first_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_en.md b/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_en.md new file mode 100644 index 00000000000000..6487e0916b2973 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English medical_note_segmenter T5Transformer from kswanjitsu +author: John Snow Labs +name: medical_note_segmenter +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medical_note_segmenter` is a English model originally trained by kswanjitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medical_note_segmenter_en_5.4.2_3.0_1724496032365.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medical_note_segmenter_en_5.4.2_3.0_1724496032365.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("medical_note_segmenter","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("medical_note_segmenter", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medical_note_segmenter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kswanjitsu/medical_note_segmenter \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_pipeline_en.md new file mode 100644 index 00000000000000..ed763a6da7a63a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-medical_note_segmenter_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English medical_note_segmenter_pipeline pipeline T5Transformer from kswanjitsu +author: John Snow Labs +name: medical_note_segmenter_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medical_note_segmenter_pipeline` is a English model originally trained by kswanjitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medical_note_segmenter_pipeline_en_5.4.2_3.0_1724496175841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medical_note_segmenter_pipeline_en_5.4.2_3.0_1724496175841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("medical_note_segmenter_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("medical_note_segmenter_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medical_note_segmenter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kswanjitsu/medical_note_segmenter + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_en.md new file mode 100644 index 00000000000000..e6bdbd31c03285 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English meta_baseline_t5_small T5Transformer from Brendan +author: John Snow Labs +name: meta_baseline_t5_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`meta_baseline_t5_small` is a English model originally trained by Brendan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/meta_baseline_t5_small_en_5.4.2_3.0_1724518845319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/meta_baseline_t5_small_en_5.4.2_3.0_1724518845319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("meta_baseline_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("meta_baseline_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|meta_baseline_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Brendan/meta-baseline-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..7ba01c3cc3f06c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-meta_baseline_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English meta_baseline_t5_small_pipeline pipeline T5Transformer from Brendan +author: John Snow Labs +name: meta_baseline_t5_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`meta_baseline_t5_small_pipeline` is a English model originally trained by Brendan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/meta_baseline_t5_small_pipeline_en_5.4.2_3.0_1724518861773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/meta_baseline_t5_small_pipeline_en_5.4.2_3.0_1724518861773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("meta_baseline_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("meta_baseline_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|meta_baseline_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Brendan/meta-baseline-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_en.md new file mode 100644 index 00000000000000..dc7612ee25089c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mix_training_english_du_dutch_1 T5Transformer from Bistolero +author: John Snow Labs +name: mix_training_english_du_dutch_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mix_training_english_du_dutch_1` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mix_training_english_du_dutch_1_en_5.4.2_3.0_1724526385985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mix_training_english_du_dutch_1_en_5.4.2_3.0_1724526385985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mix_training_english_du_dutch_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mix_training_english_du_dutch_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mix_training_english_du_dutch_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/mix_training_en_du_nl_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_pipeline_en.md new file mode 100644 index 00000000000000..3c62f7f13c67fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mix_training_english_du_dutch_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mix_training_english_du_dutch_1_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: mix_training_english_du_dutch_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mix_training_english_du_dutch_1_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mix_training_english_du_dutch_1_pipeline_en_5.4.2_3.0_1724526536934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mix_training_english_du_dutch_1_pipeline_en_5.4.2_3.0_1724526536934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mix_training_english_du_dutch_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mix_training_english_du_dutch_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mix_training_english_du_dutch_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/mix_training_en_du_nl_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mokkachat_en.md b/docs/_posts/ahmedlone127/2024-08-24-mokkachat_en.md new file mode 100644 index 00000000000000..09c97effa801b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mokkachat_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mokkachat T5Transformer from ssounda1 +author: John Snow Labs +name: mokkachat +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mokkachat` is a English model originally trained by ssounda1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mokkachat_en_5.4.2_3.0_1724475944138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mokkachat_en_5.4.2_3.0_1724475944138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mokkachat","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mokkachat", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mokkachat| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ssounda1/MokkaChat \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mokkachat_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mokkachat_pipeline_en.md new file mode 100644 index 00000000000000..f314310222a37c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mokkachat_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mokkachat_pipeline pipeline T5Transformer from ssounda1 +author: John Snow Labs +name: mokkachat_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mokkachat_pipeline` is a English model originally trained by ssounda1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mokkachat_pipeline_en_5.4.2_3.0_1724475993225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mokkachat_pipeline_en_5.4.2_3.0_1724475993225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mokkachat_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mokkachat_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mokkachat_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ssounda1/MokkaChat + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_en.md b/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_en.md new file mode 100644 index 00000000000000..002d33f4f9d3f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_small_extra_feature_fine_tune T5Transformer from Phudish +author: John Snow Labs +name: molt5_small_extra_feature_fine_tune +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_small_extra_feature_fine_tune` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_small_extra_feature_fine_tune_en_5.4.2_3.0_1724491405566.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_small_extra_feature_fine_tune_en_5.4.2_3.0_1724491405566.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_small_extra_feature_fine_tune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_small_extra_feature_fine_tune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_small_extra_feature_fine_tune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Phudish/molt5-small-extra-feature-fine-tune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_pipeline_en.md new file mode 100644 index 00000000000000..38883a4e15ef13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-molt5_small_extra_feature_fine_tune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_small_extra_feature_fine_tune_pipeline pipeline T5Transformer from Phudish +author: John Snow Labs +name: molt5_small_extra_feature_fine_tune_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_small_extra_feature_fine_tune_pipeline` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_small_extra_feature_fine_tune_pipeline_en_5.4.2_3.0_1724491421615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_small_extra_feature_fine_tune_pipeline_en_5.4.2_3.0_1724491421615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_small_extra_feature_fine_tune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_small_extra_feature_fine_tune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_small_extra_feature_fine_tune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Phudish/molt5-small-extra-feature-fine-tune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_en.md new file mode 100644 index 00000000000000..0b45955fc6533f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mrpc_t5_large_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_large_seed_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_large_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_2_en_5.4.2_3.0_1724472739681.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_2_en_5.4.2_3.0_1724472739681.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mrpc_t5_large_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mrpc_t5_large_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_large_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-large_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..9900ebcc0a7843 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mrpc_t5_large_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mrpc_t5_large_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_large_seed_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_large_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724472937247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724472937247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mrpc_t5_large_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mrpc_t5_large_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_large_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-large_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_en.md new file mode 100644 index 00000000000000..c71bbed61bc781 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_aym_lex_try3 T5Transformer from alvations +author: John Snow Labs +name: mt5_aym_lex_try3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_aym_lex_try3` is a English model originally trained by alvations. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try3_en_5.4.2_3.0_1724471380626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try3_en_5.4.2_3.0_1724471380626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_aym_lex_try3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_aym_lex_try3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_aym_lex_try3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/alvations/mt5-aym-lex-try3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_pipeline_en.md new file mode 100644 index 00000000000000..fe873847f8f993 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_aym_lex_try3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_aym_lex_try3_pipeline pipeline T5Transformer from alvations +author: John Snow Labs +name: mt5_aym_lex_try3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_aym_lex_try3_pipeline` is a English model originally trained by alvations. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try3_pipeline_en_5.4.2_3.0_1724471659484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try3_pipeline_en_5.4.2_3.0_1724471659484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_aym_lex_try3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_aym_lex_try3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_aym_lex_try3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/alvations/mt5-aym-lex-try3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_en.md new file mode 100644 index 00000000000000..9e649713391734 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_all_50000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_50000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_50000_en_5.4.2_3.0_1724533712307.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_50000_en_5.4.2_3.0_1724533712307.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_all_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_all_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_pipeline_en.md new file mode 100644 index 00000000000000..69140d89c18041 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_all_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_all_50000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_50000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_50000_pipeline_en_5.4.2_3.0_1724533901198.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_50000_pipeline_en_5.4.2_3.0_1724533901198.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_all_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_all_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..c262637f0840bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_dequad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_dequad_qag_trimmed_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qag_trimmed_50000_en_5.4.2_3.0_1724510224319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qag_trimmed_50000_en_5.4.2_3.0_1724510224319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_dequad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_dequad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-dequad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..c078324f408ff1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_dequad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_dequad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_dequad_qag_trimmed_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724510291931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724510291931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_dequad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_dequad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-dequad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_en.md new file mode 100644 index 00000000000000..2570d4f63be929 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_eng_yor_maltese T5Transformer from Davlan +author: John Snow Labs +name: mt5_base_eng_yor_maltese +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_eng_yor_maltese` is a English model originally trained by Davlan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_eng_yor_maltese_en_5.4.2_3.0_1724470149851.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_eng_yor_maltese_en_5.4.2_3.0_1724470149851.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_eng_yor_maltese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_eng_yor_maltese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_eng_yor_maltese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/Davlan/mt5_base_eng_yor_mt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_pipeline_en.md new file mode 100644 index 00000000000000..c7f71669398ac5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_eng_yor_maltese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_eng_yor_maltese_pipeline pipeline T5Transformer from Davlan +author: John Snow Labs +name: mt5_base_eng_yor_maltese_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_eng_yor_maltese_pipeline` is a English model originally trained by Davlan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_eng_yor_maltese_pipeline_en_5.4.2_3.0_1724470425652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_eng_yor_maltese_pipeline_en_5.4.2_3.0_1724470425652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_eng_yor_maltese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_eng_yor_maltese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_eng_yor_maltese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/Davlan/mt5_base_eng_yor_mt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..fb43156b920600 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_esquad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qag_trimmed_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_trimmed_50000_en_5.4.2_3.0_1724483520126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_trimmed_50000_en_5.4.2_3.0_1724483520126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..534e932fb031b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_esquad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_esquad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qag_trimmed_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724483576005.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724483576005.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_arabic_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_arabic_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..f8efa4972f397b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_arabic_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_arabic_tonga_tonga_islands_english T5Transformer from Shamus +author: John Snow Labs +name: mt5_base_finetuned_arabic_tonga_tonga_islands_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_arabic_tonga_tonga_islands_english` is a English model originally trained by Shamus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_arabic_tonga_tonga_islands_english_en_5.4.2_3.0_1724538083575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_arabic_tonga_tonga_islands_english_en_5.4.2_3.0_1724538083575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_arabic_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_arabic_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_arabic_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Shamus/mt5-base-finetuned-ar-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american_en.md new file mode 100644 index 00000000000000..31cb31d3f88902 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american_en_5.4.2_3.0_1724524172962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american_en_5.4.2_3.0_1724524172962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_gujarati_tonga_tonga_islands_english_filthy_american| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-base-finetuned-gu-to-en-filthy-American \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..52687f87fb7426 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_itquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_itquad_ae_trimmed_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_itquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_trimmed_50000_en_5.4.2_3.0_1724479583502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_trimmed_50000_en_5.4.2_3.0_1724479583502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_itquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_itquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_itquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-itquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..03aa8f4b6d7d69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_itquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_itquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_itquad_ae_trimmed_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_itquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724479638405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724479638405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_itquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_itquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_itquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-itquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_en.md new file mode 100644 index 00000000000000..51f1e751d89f73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_joseluis95 T5Transformer from JoseLuis95 +author: John Snow Labs +name: mt5_base_joseluis95 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_joseluis95` is a English model originally trained by JoseLuis95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_joseluis95_en_5.4.2_3.0_1724497411140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_joseluis95_en_5.4.2_3.0_1724497411140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_joseluis95","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_joseluis95", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_joseluis95| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/JoseLuis95/mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_pipeline_en.md new file mode 100644 index 00000000000000..cd8da127bf3ae4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_joseluis95_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_joseluis95_pipeline pipeline T5Transformer from JoseLuis95 +author: John Snow Labs +name: mt5_base_joseluis95_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_joseluis95_pipeline` is a English model originally trained by JoseLuis95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_joseluis95_pipeline_en_5.4.2_3.0_1724497679445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_joseluis95_pipeline_en_5.4.2_3.0_1724497679445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_joseluis95_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_joseluis95_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_joseluis95_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/JoseLuis95/mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..fbc5ccfa57ec8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_koquad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_koquad_qag_trimmed_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_koquad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qag_trimmed_50000_en_5.4.2_3.0_1724458454542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qag_trimmed_50000_en_5.4.2_3.0_1724458454542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_koquad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_koquad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_koquad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-koquad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..2cea742b0d26bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_koquad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_koquad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_koquad_qag_trimmed_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_koquad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724458512007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724458512007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_koquad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_koquad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_koquad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-koquad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_en.md new file mode 100644 index 00000000000000..3d5a3e03050f96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_multi_label_all_czech_iv T5Transformer from chi2024 +author: John Snow Labs +name: mt5_base_multi_label_all_czech_iv +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_multi_label_all_czech_iv` is a English model originally trained by chi2024. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_multi_label_all_czech_iv_en_5.4.2_3.0_1724499520177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_multi_label_all_czech_iv_en_5.4.2_3.0_1724499520177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_multi_label_all_czech_iv","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_multi_label_all_czech_iv", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_multi_label_all_czech_iv| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chi2024/mt5-base-multi-label-all-cs-iv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_pipeline_en.md new file mode 100644 index 00000000000000..7feb7794bcc6a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_multi_label_all_czech_iv_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_multi_label_all_czech_iv_pipeline pipeline T5Transformer from chi2024 +author: John Snow Labs +name: mt5_base_multi_label_all_czech_iv_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_multi_label_all_czech_iv_pipeline` is a English model originally trained by chi2024. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_multi_label_all_czech_iv_pipeline_en_5.4.2_3.0_1724499800739.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_multi_label_all_czech_iv_pipeline_en_5.4.2_3.0_1724499800739.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_multi_label_all_czech_iv_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_multi_label_all_czech_iv_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_multi_label_all_czech_iv_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chi2024/mt5-base-multi-label-all-cs-iv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_en.md new file mode 100644 index 00000000000000..1209f88ea48c49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_spanish_aex T5Transformer from davidFD19 +author: John Snow Labs +name: mt5_base_spanish_aex +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_spanish_aex` is a English model originally trained by davidFD19. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_aex_en_5.4.2_3.0_1724492406810.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_aex_en_5.4.2_3.0_1724492406810.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_spanish_aex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_spanish_aex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_spanish_aex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/davidFD19/mt5-base-es-aex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_pipeline_en.md new file mode 100644 index 00000000000000..8ffd542e76b889 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_spanish_aex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_spanish_aex_pipeline pipeline T5Transformer from davidFD19 +author: John Snow Labs +name: mt5_base_spanish_aex_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_spanish_aex_pipeline` is a English model originally trained by davidFD19. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_aex_pipeline_en_5.4.2_3.0_1724492553300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_aex_pipeline_en_5.4.2_3.0_1724492553300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_spanish_aex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_spanish_aex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_spanish_aex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/davidFD19/mt5-base-es-aex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_base_squad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_squad_qg_en.md new file mode 100644 index 00000000000000..b73c6f184ea76c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_base_squad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_squad_qg T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_squad_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_squad_qg` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_squad_qg_en_5.4.2_3.0_1724458257074.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_squad_qg_en_5.4.2_3.0_1724458257074.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_squad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_squad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_squad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_en.md new file mode 100644 index 00000000000000..0482e0eaf0d097 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_counter_narrative_english T5Transformer from HiTZ +author: John Snow Labs +name: mt5_counter_narrative_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_counter_narrative_english` is a English model originally trained by HiTZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_counter_narrative_english_en_5.4.2_3.0_1724513361159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_counter_narrative_english_en_5.4.2_3.0_1724513361159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_counter_narrative_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_counter_narrative_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_counter_narrative_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/HiTZ/mt5-counter-narrative-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_pipeline_en.md new file mode 100644 index 00000000000000..ba9b4046086fda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_counter_narrative_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_counter_narrative_english_pipeline pipeline T5Transformer from HiTZ +author: John Snow Labs +name: mt5_counter_narrative_english_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_counter_narrative_english_pipeline` is a English model originally trained by HiTZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_counter_narrative_english_pipeline_en_5.4.2_3.0_1724513674948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_counter_narrative_english_pipeline_en_5.4.2_3.0_1724513674948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_counter_narrative_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_counter_narrative_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_counter_narrative_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/HiTZ/mt5-counter-narrative-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_en.md new file mode 100644 index 00000000000000..b5f2c8b6a6d85a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines T5Transformer from sorayutmild +author: John Snow Labs +name: mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines` is a English model originally trained by sorayutmild. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_en_5.4.2_3.0_1724492814508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_en_5.4.2_3.0_1724492814508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/sorayutmild/mt5-cpe-kmutt-thai-sentence-sum-finetuned-sanook-news-headlines \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline_en.md new file mode 100644 index 00000000000000..3d7093696ab991 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline pipeline T5Transformer from sorayutmild +author: John Snow Labs +name: mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline` is a English model originally trained by sorayutmild. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline_en_5.4.2_3.0_1724492973835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline_en_5.4.2_3.0_1724492973835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_cpe_kmutt_thai_sentence_sum_finetuned_sanook_news_headlines_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/sorayutmild/mt5-cpe-kmutt-thai-sentence-sum-finetuned-sanook-news-headlines + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_en.md new file mode 100644 index 00000000000000..027366ae2238b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_japanese T5Transformer from sigmoid +author: John Snow Labs +name: mt5_english_japanese +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_japanese` is a English model originally trained by sigmoid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_japanese_en_5.4.2_3.0_1724502313976.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_japanese_en_5.4.2_3.0_1724502313976.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_japanese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_japanese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_japanese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/sigmoid/mt5-en-ja \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_pipeline_en.md new file mode 100644 index 00000000000000..a1ca337674da44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_english_japanese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_english_japanese_pipeline pipeline T5Transformer from sigmoid +author: John Snow Labs +name: mt5_english_japanese_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_japanese_pipeline` is a English model originally trained by sigmoid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_japanese_pipeline_en_5.4.2_3.0_1724502545571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_japanese_pipeline_en_5.4.2_3.0_1724502545571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_english_japanese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_english_japanese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_japanese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/sigmoid/mt5-en-ja + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_en.md new file mode 100644 index 00000000000000..f3f3b75ce6d472 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_news_thaisum T5Transformer from Sundione +author: John Snow Labs +name: mt5_news_thaisum +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_news_thaisum` is a English model originally trained by Sundione. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_news_thaisum_en_5.4.2_3.0_1724485558865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_news_thaisum_en_5.4.2_3.0_1724485558865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_news_thaisum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_news_thaisum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_news_thaisum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Sundione/mt5-news-thaisum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_pipeline_en.md new file mode 100644 index 00000000000000..eedf5ef66d5dcf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_news_thaisum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_news_thaisum_pipeline pipeline T5Transformer from Sundione +author: John Snow Labs +name: mt5_news_thaisum_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_news_thaisum_pipeline` is a English model originally trained by Sundione. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_news_thaisum_pipeline_en_5.4.2_3.0_1724485640765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_news_thaisum_pipeline_en_5.4.2_3.0_1724485640765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_news_thaisum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_news_thaisum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_news_thaisum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Sundione/mt5-news-thaisum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_en.md new file mode 100644 index 00000000000000..d95f641c1ce9b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_slovaksum_smesum_bs8 T5Transformer from ctu-aic +author: John Snow Labs +name: mt5_slovaksum_smesum_bs8 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_slovaksum_smesum_bs8` is a English model originally trained by ctu-aic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_smesum_bs8_en_5.4.2_3.0_1724532760957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_smesum_bs8_en_5.4.2_3.0_1724532760957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_slovaksum_smesum_bs8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_slovaksum_smesum_bs8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_slovaksum_smesum_bs8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/ctu-aic/mt5-slovaksum-smesum-bs8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_pipeline_en.md new file mode 100644 index 00000000000000..e93f859c1b2f54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_slovaksum_smesum_bs8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_slovaksum_smesum_bs8_pipeline pipeline T5Transformer from ctu-aic +author: John Snow Labs +name: mt5_slovaksum_smesum_bs8_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_slovaksum_smesum_bs8_pipeline` is a English model originally trained by ctu-aic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_smesum_bs8_pipeline_en_5.4.2_3.0_1724532898838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_smesum_bs8_pipeline_en_5.4.2_3.0_1724532898838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_slovaksum_smesum_bs8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_slovaksum_smesum_bs8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_slovaksum_smesum_bs8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/ctu-aic/mt5-slovaksum-smesum-bs8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_en.md new file mode 100644 index 00000000000000..009d8893ae33b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_50 T5Transformer from msbayindir +author: John Snow Labs +name: mt5_small_50 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_50` is a English model originally trained by msbayindir. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_50_en_5.4.2_3.0_1724540966631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_50_en_5.4.2_3.0_1724540966631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/msbayindir/mt5_small_50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_pipeline_en.md new file mode 100644 index 00000000000000..6592512b6ff900 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_50_pipeline pipeline T5Transformer from msbayindir +author: John Snow Labs +name: mt5_small_50_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_50_pipeline` is a English model originally trained by msbayindir. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_50_pipeline_en_5.4.2_3.0_1724541137464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_50_pipeline_en_5.4.2_3.0_1724541137464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/msbayindir/mt5_small_50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_en.md new file mode 100644 index 00000000000000..10778467798ac4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_afrikaans_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_afrikaans_10k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_afrikaans_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_afrikaans_10k_en_5.4.2_3.0_1724488142821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_afrikaans_10k_en_5.4.2_3.0_1724488142821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_afrikaans_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_afrikaans_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_afrikaans_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-af-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_pipeline_en.md new file mode 100644 index 00000000000000..2e9b7efe339b90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_afrikaans_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_afrikaans_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_afrikaans_10k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_afrikaans_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_afrikaans_10k_pipeline_en_5.4.2_3.0_1724488302007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_afrikaans_10k_pipeline_en_5.4.2_3.0_1724488302007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_afrikaans_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_afrikaans_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_afrikaans_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-af-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_en.md new file mode 100644 index 00000000000000..1369a82eedb5f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_all_100000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_all_100000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_all_100000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_all_100000_en_5.4.2_3.0_1724500940171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_all_100000_en_5.4.2_3.0_1724500940171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_all_100000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_all_100000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_all_100000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_all_100000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_pipeline_en.md new file mode 100644 index 00000000000000..17a97a8ff62f9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_all_100000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_all_100000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_all_100000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_all_100000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_all_100000_pipeline_en_5.4.2_3.0_1724501044668.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_all_100000_pipeline_en_5.4.2_3.0_1724501044668.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_all_100000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_all_100000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_all_100000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_all_100000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_en.md new file mode 100644 index 00000000000000..26d986edef0364 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_bulgarian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_bulgarian_10k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_bulgarian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_bulgarian_10k_en_5.4.2_3.0_1724464476057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_bulgarian_10k_en_5.4.2_3.0_1724464476057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_bulgarian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_bulgarian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_bulgarian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-bg-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_pipeline_en.md new file mode 100644 index 00000000000000..c675b4ad14b766 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_bulgarian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_bulgarian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_bulgarian_10k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_bulgarian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_bulgarian_10k_pipeline_en_5.4.2_3.0_1724464631013.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_bulgarian_10k_pipeline_en_5.4.2_3.0_1724464631013.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_bulgarian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_bulgarian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_bulgarian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-bg-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_en.md new file mode 100644 index 00000000000000..f1bcf51a4c2c8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_30000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_30000_en_5.4.2_3.0_1724514579595.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_30000_en_5.4.2_3.0_1724514579595.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_pipeline_en.md new file mode 100644 index 00000000000000..02b4fdad4fa16a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qa_trimmed_spanish_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_30000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_30000_pipeline_en_5.4.2_3.0_1724514596432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_30000_pipeline_en_5.4.2_3.0_1724514596432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..5cc567178c8b82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qg_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_esquad_qg_ae_trimmed_50000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724505869208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724505869208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qg_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qg_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|434.2 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-esquad-qg-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..19b07bdd53524b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qg_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_esquad_qg_ae_trimmed_50000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724505891357.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724505891357.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qg_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qg_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|434.2 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-esquad-qg-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_en.md new file mode 100644 index 00000000000000..1a34ec6a5b8b11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qg_trimmed_spanish_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qg_trimmed_spanish_15000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_trimmed_spanish_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_15000_en_5.4.2_3.0_1724515271089.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_15000_en_5.4.2_3.0_1724515271089.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qg_trimmed_spanish_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qg_trimmed_spanish_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_trimmed_spanish_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|252.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qg-trimmed-es-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_pipeline_en.md new file mode 100644 index 00000000000000..dd04b071d043fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_esquad_qg_trimmed_spanish_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qg_trimmed_spanish_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qg_trimmed_spanish_15000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_trimmed_spanish_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724515283451.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724515283451.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qg_trimmed_spanish_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qg_trimmed_spanish_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_trimmed_spanish_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|252.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qg-trimmed-es-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_en.md new file mode 100644 index 00000000000000..bb752353189274 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_1_en_5.4.2_3.0_1724535074995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_1_en_5.4.2_3.0_1724535074995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_pipeline_en.md new file mode 100644 index 00000000000000..a1e7687a7fa311 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_1_pipeline_en_5.4.2_3.0_1724535319967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_1_pipeline_en_5.4.2_3.0_1724535319967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_26jan_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_26jan_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_en.md new file mode 100644 index 00000000000000..b545dac74e8ff2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_6 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_6` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_6_en_5.4.2_3.0_1724506808311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_6_en_5.4.2_3.0_1724506808311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_pipeline_en.md new file mode 100644 index 00000000000000..2cf788937f3f2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_26jan_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_6_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_6_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_6_pipeline_en_5.4.2_3.0_1724506903017.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_6_pipeline_en_5.4.2_3.0_1724506903017.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_26jan_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_26jan_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_en.md new file mode 100644 index 00000000000000..e1c523f0ed180c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_20220901_001521 T5Transformer from whatdhack +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_20220901_001521 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_20220901_001521` is a English model originally trained by whatdhack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_20220901_001521_en_5.4.2_3.0_1724465932626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_20220901_001521_en_5.4.2_3.0_1724465932626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_20220901_001521","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_20220901_001521", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_20220901_001521| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/whatdhack/mt5-small-finetuned-amazon-en-es-20220901_001521 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline_en.md new file mode 100644 index 00000000000000..a346ce6b4349d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline pipeline T5Transformer from whatdhack +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline` is a English model originally trained by whatdhack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline_en_5.4.2_3.0_1724466023092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline_en_5.4.2_3.0_1724466023092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_20220901_001521_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/whatdhack/mt5-small-finetuned-amazon-en-es-20220901_001521 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_en.md new file mode 100644 index 00000000000000..abd94d7b022a2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jwchung T5Transformer from jwchung +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jwchung +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jwchung` is a English model originally trained by jwchung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jwchung_en_5.4.2_3.0_1724528137686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jwchung_en_5.4.2_3.0_1724528137686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jwchung","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jwchung", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jwchung| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jwchung/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline_en.md new file mode 100644 index 00000000000000..8bd620ed1b6355 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline pipeline T5Transformer from jwchung +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline` is a English model originally trained by jwchung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline_en_5.4.2_3.0_1724528227634.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline_en_5.4.2_3.0_1724528227634.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jwchung_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jwchung/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_en.md new file mode 100644 index 00000000000000..9fbe404db2c146 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_linhkhanhoang T5Transformer from linhkhanhoang +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_linhkhanhoang +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_linhkhanhoang` is a English model originally trained by linhkhanhoang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_en_5.4.2_3.0_1724508395214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_en_5.4.2_3.0_1724508395214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_linhkhanhoang","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_linhkhanhoang", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_linhkhanhoang| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/linhkhanhoang/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline_en.md new file mode 100644 index 00000000000000..4f976c364ef14b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline pipeline T5Transformer from linhkhanhoang +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline` is a English model originally trained by linhkhanhoang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline_en_5.4.2_3.0_1724508486390.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline_en_5.4.2_3.0_1724508486390.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_linhkhanhoang_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/linhkhanhoang/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_en.md new file mode 100644 index 00000000000000..5b5c3a0b7fe7fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_sarthakc44 T5Transformer from sarthakc44 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_sarthakc44 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_sarthakc44` is a English model originally trained by sarthakc44. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_sarthakc44_en_5.4.2_3.0_1724501306947.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_sarthakc44_en_5.4.2_3.0_1724501306947.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_sarthakc44","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_sarthakc44", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_sarthakc44| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sarthakc44/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline_en.md new file mode 100644 index 00000000000000..76cfbe966fff9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline pipeline T5Transformer from sarthakc44 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline` is a English model originally trained by sarthakc44. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline_en_5.4.2_3.0_1724501398609.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline_en_5.4.2_3.0_1724501398609.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_sarthakc44_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sarthakc44/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_en.md new file mode 100644 index 00000000000000..630cc88b8d516f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_st3rl4nce T5Transformer from st3rl4nce +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_st3rl4nce +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_st3rl4nce` is a English model originally trained by st3rl4nce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_st3rl4nce_en_5.4.2_3.0_1724495018069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_st3rl4nce_en_5.4.2_3.0_1724495018069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_st3rl4nce","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_st3rl4nce", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_st3rl4nce| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/st3rl4nce/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline_en.md new file mode 100644 index 00000000000000..185a12a3e89404 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline pipeline T5Transformer from st3rl4nce +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline` is a English model originally trained by st3rl4nce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline_en_5.4.2_3.0_1724495114623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline_en_5.4.2_3.0_1724495114623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_st3rl4nce_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/st3rl4nce/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_en.md new file mode 100644 index 00000000000000..141d1f2c3f44bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tehranixyz T5Transformer from tehranixyz +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tehranixyz +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tehranixyz` is a English model originally trained by tehranixyz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tehranixyz_en_5.4.2_3.0_1724495775610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tehranixyz_en_5.4.2_3.0_1724495775610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tehranixyz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tehranixyz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tehranixyz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tehranixyz/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline_en.md new file mode 100644 index 00000000000000..3951820ded90a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline pipeline T5Transformer from tehranixyz +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline` is a English model originally trained by tehranixyz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline_en_5.4.2_3.0_1724495902383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline_en_5.4.2_3.0_1724495902383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tehranixyz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tehranixyz/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_en.md new file mode 100644 index 00000000000000..524628bbe0f0f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_vickysirwani T5Transformer from vickysirwani +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_vickysirwani +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_vickysirwani` is a English model originally trained by vickysirwani. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vickysirwani_en_5.4.2_3.0_1724538467117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vickysirwani_en_5.4.2_3.0_1724538467117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_vickysirwani","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_vickysirwani", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_vickysirwani| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/vickysirwani/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline_en.md new file mode 100644 index 00000000000000..4877cdba03e061 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline pipeline T5Transformer from vickysirwani +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline` is a English model originally trained by vickysirwani. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline_en_5.4.2_3.0_1724538579801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline_en_5.4.2_3.0_1724538579801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_vickysirwani_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/vickysirwani/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_en.md new file mode 100644 index 00000000000000..0d4641073c609d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_cnn_dailymail_madmarx37 T5Transformer from MadMarx37 +author: John Snow Labs +name: mt5_small_finetuned_cnn_dailymail_madmarx37 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_cnn_dailymail_madmarx37` is a English model originally trained by MadMarx37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_cnn_dailymail_madmarx37_en_5.4.2_3.0_1724488406629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_cnn_dailymail_madmarx37_en_5.4.2_3.0_1724488406629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_cnn_dailymail_madmarx37","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_cnn_dailymail_madmarx37", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_cnn_dailymail_madmarx37| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/MadMarx37/mt5-small-finetuned-cnn-dailymail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline_en.md new file mode 100644 index 00000000000000..d5c417f2525b59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline pipeline T5Transformer from MadMarx37 +author: John Snow Labs +name: mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline` is a English model originally trained by MadMarx37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline_en_5.4.2_3.0_1724488488643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline_en_5.4.2_3.0_1724488488643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_cnn_dailymail_madmarx37_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/MadMarx37/mt5-small-finetuned-cnn-dailymail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_en.md new file mode 100644 index 00000000000000..53d9d045e619c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan T5Transformer from Rooshan +author: John Snow Labs +name: mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan` is a English model originally trained by Rooshan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_en_5.4.2_3.0_1724473249193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_en_5.4.2_3.0_1724473249193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/Rooshan/mt5-small-finetuned-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline_en.md new file mode 100644 index 00000000000000..4f553035ea91e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline pipeline T5Transformer from Rooshan +author: John Snow Labs +name: mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline` is a English model originally trained by Rooshan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline_en_5.4.2_3.0_1724473530072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline_en_5.4.2_3.0_1724473530072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_english_tonga_tonga_islands_german_rooshan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/Rooshan/mt5-small-finetuned-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_en.md new file mode 100644 index 00000000000000..17d51ad2fd262d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_mt5_small_poem_hemen T5Transformer from shkna1368 +author: John Snow Labs +name: mt5_small_finetuned_mt5_small_poem_hemen +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mt5_small_poem_hemen` is a English model originally trained by shkna1368. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_small_poem_hemen_en_5.4.2_3.0_1724528231453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_small_poem_hemen_en_5.4.2_3.0_1724528231453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_mt5_small_poem_hemen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_mt5_small_poem_hemen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mt5_small_poem_hemen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shkna1368/mt5-small-finetuned-mt5-small-poem-hemen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_pipeline_en.md new file mode 100644 index 00000000000000..2d61f1c09b77f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_mt5_small_poem_hemen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_mt5_small_poem_hemen_pipeline pipeline T5Transformer from shkna1368 +author: John Snow Labs +name: mt5_small_finetuned_mt5_small_poem_hemen_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mt5_small_poem_hemen_pipeline` is a English model originally trained by shkna1368. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_small_poem_hemen_pipeline_en_5.4.2_3.0_1724528407252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_small_poem_hemen_pipeline_en_5.4.2_3.0_1724528407252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_mt5_small_poem_hemen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_mt5_small_poem_hemen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mt5_small_poem_hemen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shkna1368/mt5-small-finetuned-mt5-small-poem-hemen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_en.md new file mode 100644 index 00000000000000..91fdbfcbb38892 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_multi_question_generation T5Transformer from mrm8488 +author: John Snow Labs +name: mt5_small_finetuned_multi_question_generation +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multi_question_generation` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multi_question_generation_en_5.4.2_3.0_1724491939801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multi_question_generation_en_5.4.2_3.0_1724491939801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_multi_question_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_multi_question_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multi_question_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/mrm8488/mT5-small-finetuned-multi-question-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_pipeline_en.md new file mode 100644 index 00000000000000..219c3255b4b28e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_multi_question_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_multi_question_generation_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: mt5_small_finetuned_multi_question_generation_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multi_question_generation_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multi_question_generation_pipeline_en_5.4.2_3.0_1724492071891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multi_question_generation_pipeline_en_5.4.2_3.0_1724492071891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_multi_question_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_multi_question_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multi_question_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/mrm8488/mT5-small-finetuned-multi-question-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_en.md new file mode 100644 index 00000000000000..4dc490b29eb2c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_summarydata T5Transformer from amr1999 +author: John Snow Labs +name: mt5_small_finetuned_summarydata +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_summarydata` is a English model originally trained by amr1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_summarydata_en_5.4.2_3.0_1724529006208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_summarydata_en_5.4.2_3.0_1724529006208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_summarydata","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_summarydata", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_summarydata| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/amr1999/mt5-small-finetuned-SummaryData \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_pipeline_en.md new file mode 100644 index 00000000000000..a802b0bfe5d2a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_summarydata_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_summarydata_pipeline pipeline T5Transformer from amr1999 +author: John Snow Labs +name: mt5_small_finetuned_summarydata_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_summarydata_pipeline` is a English model originally trained by amr1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_summarydata_pipeline_en_5.4.2_3.0_1724529097614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_summarydata_pipeline_en_5.4.2_3.0_1724529097614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_summarydata_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_summarydata_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_summarydata_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/amr1999/mt5-small-finetuned-SummaryData + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_en.md new file mode 100644 index 00000000000000..302e3cba86ea1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_urdu_english_spanish T5Transformer from anasmd4u +author: John Snow Labs +name: mt5_small_finetuned_urdu_english_spanish +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_urdu_english_spanish` is a English model originally trained by anasmd4u. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_urdu_english_spanish_en_5.4.2_3.0_1724490980369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_urdu_english_spanish_en_5.4.2_3.0_1724490980369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_urdu_english_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_urdu_english_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_urdu_english_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/anasmd4u/mt5-small-finetuned-urdu-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_pipeline_en.md new file mode 100644 index 00000000000000..545121739a29a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_finetuned_urdu_english_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_urdu_english_spanish_pipeline pipeline T5Transformer from anasmd4u +author: John Snow Labs +name: mt5_small_finetuned_urdu_english_spanish_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_urdu_english_spanish_pipeline` is a English model originally trained by anasmd4u. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_urdu_english_spanish_pipeline_en_5.4.2_3.0_1724491078702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_urdu_english_spanish_pipeline_en_5.4.2_3.0_1724491078702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_urdu_english_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_urdu_english_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_urdu_english_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/anasmd4u/mt5-small-finetuned-urdu-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_en.md new file mode 100644 index 00000000000000..c53392aa5d69a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_10000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_10000_en_5.4.2_3.0_1724493186574.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_10000_en_5.4.2_3.0_1724493186574.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|223.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_pipeline_en.md new file mode 100644 index 00000000000000..8916b7a212b3c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_frquad_qg_trimmed_french_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_10000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_10000_pipeline_en_5.4.2_3.0_1724493197664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_10000_pipeline_en_5.4.2_3.0_1724493197664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|223.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_en.md new file mode 100644 index 00000000000000..b274b100288274 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_icelandic_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_icelandic_10k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_icelandic_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_icelandic_10k_en_5.4.2_3.0_1724525737943.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_icelandic_10k_en_5.4.2_3.0_1724525737943.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_icelandic_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_icelandic_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_icelandic_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-is-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_pipeline_en.md new file mode 100644 index 00000000000000..e74437d1b6314e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_icelandic_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_icelandic_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_icelandic_10k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_icelandic_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_icelandic_10k_pipeline_en_5.4.2_3.0_1724525895583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_icelandic_10k_pipeline_en_5.4.2_3.0_1724525895583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_icelandic_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_icelandic_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_icelandic_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-is-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_en.md new file mode 100644 index 00000000000000..857352f5d220c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_qa_trimmed_italian_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qa_trimmed_italian_90000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qa_trimmed_italian_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_90000_en_5.4.2_3.0_1724518406137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_90000_en_5.4.2_3.0_1724518406137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qa_trimmed_italian_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qa_trimmed_italian_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qa_trimmed_italian_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|617.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qa-trimmed-it-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_pipeline_en.md new file mode 100644 index 00000000000000..bc775d765d1089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qa_trimmed_italian_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_qa_trimmed_italian_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qa_trimmed_italian_90000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qa_trimmed_italian_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_90000_pipeline_en_5.4.2_3.0_1724518438515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_90000_pipeline_en_5.4.2_3.0_1724518438515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qa_trimmed_italian_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qa_trimmed_italian_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qa_trimmed_italian_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|617.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qa-trimmed-it-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_it.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_it.md new file mode 100644 index 00000000000000..f2ae688d5bcc8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_itquad_qag T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qag +date: 2024-08-24 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qag` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qag_it_5.4.2_3.0_1724482441849.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qag_it_5.4.2_3.0_1724482441849.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qag","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qag", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|1.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_pipeline_it.md new file mode 100644 index 00000000000000..206a274a9f7d0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qag_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_itquad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qag_pipeline +date: 2024-08-24 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qag_pipeline` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qag_pipeline_it_5.4.2_3.0_1724482527632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qag_pipeline_it_5.4.2_3.0_1724482527632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qag_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qag_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|1.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_en.md new file mode 100644 index 00000000000000..bc88d6fe0968f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_qg_trimmed_italian_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qg_trimmed_italian_60000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_trimmed_italian_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_italian_60000_en_5.4.2_3.0_1724531075963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_italian_60000_en_5.4.2_3.0_1724531075963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qg_trimmed_italian_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qg_trimmed_italian_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_trimmed_italian_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|482.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qg-trimmed-it-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_pipeline_en.md new file mode 100644 index 00000000000000..664068113d143c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_itquad_qg_trimmed_italian_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_qg_trimmed_italian_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qg_trimmed_italian_60000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_trimmed_italian_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_italian_60000_pipeline_en_5.4.2_3.0_1724531100090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_italian_60000_pipeline_en_5.4.2_3.0_1724531100090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qg_trimmed_italian_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qg_trimmed_italian_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_trimmed_italian_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|482.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qg-trimmed-it-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_ja.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_ja.md new file mode 100644 index 00000000000000..f42b9e04e51e5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_jaquad_qa T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_jaquad_qa +date: 2024-08-24 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa` is a Japanese model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_ja_5.4.2_3.0_1724528908993.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_ja_5.4.2_3.0_1724528908993.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qa","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qa", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-jaquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_pipeline_ja.md new file mode 100644 index 00000000000000..04592a7c49b0ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qa_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_jaquad_qa_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_jaquad_qa_pipeline +date: 2024-08-24 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa_pipeline` is a Japanese model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_pipeline_ja_5.4.2_3.0_1724528997181.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_pipeline_ja_5.4.2_3.0_1724528997181.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qa_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qa_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-jaquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_en.md new file mode 100644 index 00000000000000..f1680742e1c67f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_10000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_10000_en_5.4.2_3.0_1724490069297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_10000_en_5.4.2_3.0_1724490069297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|223.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline_en.md new file mode 100644 index 00000000000000..839d56d839bacf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline_en_5.4.2_3.0_1724490080481.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline_en_5.4.2_3.0_1724490080481.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|223.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_en.md new file mode 100644 index 00000000000000..ed6629d4d4d17c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_10k_enru T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_10k_enru +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_10k_enru` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enru_en_5.4.2_3.0_1724539278431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enru_en_5.4.2_3.0_1724539278431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_10k_enru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_10k_enru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_10k_enru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-10k-enru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_pipeline_en.md new file mode 100644 index 00000000000000..9675d5b596ff1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_10k_enru_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_10k_enru_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_10k_enru_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_10k_enru_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enru_pipeline_en_5.4.2_3.0_1724539468352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enru_pipeline_en_5.4.2_3.0_1724539468352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_10k_enru_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_10k_enru_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_10k_enru_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-10k-enru + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_en.md new file mode 100644 index 00000000000000..f3bfb4ebbb6e2f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_250k_ruen T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_ruen +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_ruen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ruen_en_5.4.2_3.0_1724539491385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ruen_en_5.4.2_3.0_1724539491385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_250k_ruen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_250k_ruen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_ruen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-ruen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_pipeline_en.md new file mode 100644 index 00000000000000..7a4babbac2b181 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nc16_250k_ruen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_250k_ruen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_ruen_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_ruen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ruen_pipeline_en_5.4.2_3.0_1724539646119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ruen_pipeline_en_5.4.2_3.0_1724539646119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_250k_ruen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_250k_ruen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_ruen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-ruen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_en.md new file mode 100644 index 00000000000000..21b82b2009b261 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nepal_bhasa T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_nepal_bhasa +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nepal_bhasa` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nepal_bhasa_en_5.4.2_3.0_1724493486358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nepal_bhasa_en_5.4.2_3.0_1724493486358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..dc5f58928dddba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nepal_bhasa_pipeline pipeline T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_nepal_bhasa_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nepal_bhasa_pipeline` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nepal_bhasa_pipeline_en_5.4.2_3.0_1724493642739.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nepal_bhasa_pipeline_en_5.4.2_3.0_1724493642739.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_pipeline_zh.md new file mode 100644 index 00000000000000..57586cdaf5c7fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese mt5_small_nlu_all_crosswoz_pipeline pipeline T5Transformer from ConvLab +author: John Snow Labs +name: mt5_small_nlu_all_crosswoz_pipeline +date: 2024-08-24 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nlu_all_crosswoz_pipeline` is a Chinese model originally trained by ConvLab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nlu_all_crosswoz_pipeline_zh_5.4.2_3.0_1724459540234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nlu_all_crosswoz_pipeline_zh_5.4.2_3.0_1724459540234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nlu_all_crosswoz_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nlu_all_crosswoz_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nlu_all_crosswoz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ConvLab/mt5-small-nlu-all-crosswoz + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_zh.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_zh.md new file mode 100644 index 00000000000000..0bc6802e53725a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_nlu_all_crosswoz_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese mt5_small_nlu_all_crosswoz T5Transformer from ConvLab +author: John Snow Labs +name: mt5_small_nlu_all_crosswoz +date: 2024-08-24 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nlu_all_crosswoz` is a Chinese model originally trained by ConvLab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nlu_all_crosswoz_zh_5.4.2_3.0_1724459349690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nlu_all_crosswoz_zh_5.4.2_3.0_1724459349690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nlu_all_crosswoz","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nlu_all_crosswoz", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nlu_all_crosswoz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ConvLab/mt5-small-nlu-all-crosswoz \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_en.md new file mode 100644 index 00000000000000..0ee530bac457a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_paracrawl_enen T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_enen +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_enen` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_enen_en_5.4.2_3.0_1724534602971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_enen_en_5.4.2_3.0_1724534602971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_paracrawl_enen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_paracrawl_enen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_enen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-enen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_pipeline_en.md new file mode 100644 index 00000000000000..890ecbb9dbe091 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_paracrawl_enen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_paracrawl_enen_pipeline pipeline T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_enen_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_enen_pipeline` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_enen_pipeline_en_5.4.2_3.0_1724534688150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_enen_pipeline_en_5.4.2_3.0_1724534688150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_paracrawl_enen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_paracrawl_enen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_enen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-enen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_en.md new file mode 100644 index 00000000000000..e1da8d7046099b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_persian_farsi_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_persian_farsi_10k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_persian_farsi_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_persian_farsi_10k_en_5.4.2_3.0_1724467938725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_persian_farsi_10k_en_5.4.2_3.0_1724467938725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_persian_farsi_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_persian_farsi_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_persian_farsi_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-fa-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_pipeline_en.md new file mode 100644 index 00000000000000..4ee0e07ea26461 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_persian_farsi_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_persian_farsi_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_persian_farsi_10k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_persian_farsi_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_persian_farsi_10k_pipeline_en_5.4.2_3.0_1724468107498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_persian_farsi_10k_pipeline_en_5.4.2_3.0_1724468107498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_persian_farsi_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_persian_farsi_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_persian_farsi_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-fa-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_en.md new file mode 100644 index 00000000000000..74820bc648d5a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_psxjp5 T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_psxjp5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_psxjp5` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_psxjp5_en_5.4.2_3.0_1724475889856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_psxjp5_en_5.4.2_3.0_1724475889856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_psxjp5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_psxjp5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_psxjp5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_pipeline_en.md new file mode 100644 index 00000000000000..8e3f3396fe9377 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_psxjp5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_psxjp5_pipeline pipeline T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_psxjp5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_psxjp5_pipeline` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_psxjp5_pipeline_en_5.4.2_3.0_1724475972092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_psxjp5_pipeline_en_5.4.2_3.0_1724475972092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_psxjp5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_psxjp5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_psxjp5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_ae_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_ae_pipeline_ru.md new file mode 100644 index 00000000000000..a922fb932fd713 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_ae_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_ruquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_ruquad_ae_pipeline +date: 2024-08-24 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_ae_pipeline` is a Russian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_ae_pipeline_ru_5.4.2_3.0_1724540851930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_ae_pipeline_ru_5.4.2_3.0_1724540851930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_ae_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_ae_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-ruquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_en.md new file mode 100644 index 00000000000000..da51b271d145d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qa_trimmed_russian T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qa_trimmed_russian +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qa_trimmed_russian` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_en_5.4.2_3.0_1724515088086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_en_5.4.2_3.0_1724515088086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qa_trimmed_russian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qa_trimmed_russian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qa_trimmed_russian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|825.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qa-trimmed-ru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_pipeline_en.md new file mode 100644 index 00000000000000..8ae4d273843a3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qa_trimmed_russian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qa_trimmed_russian_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qa_trimmed_russian_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qa_trimmed_russian_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_pipeline_en_5.4.2_3.0_1724515149822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_pipeline_en_5.4.2_3.0_1724515149822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qa_trimmed_russian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qa_trimmed_russian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qa_trimmed_russian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|825.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qa-trimmed-ru + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_en.md new file mode 100644 index 00000000000000..6a83b4301f9575 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_60000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_60000_en_5.4.2_3.0_1724541657967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_60000_en_5.4.2_3.0_1724541657967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|466.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_pipeline_en.md new file mode 100644 index 00000000000000..8520c7cc008153 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_ruquad_qg_trimmed_russian_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_60000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_60000_pipeline_en_5.4.2_3.0_1724541688287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_60000_pipeline_en_5.4.2_3.0_1724541688287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|466.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_en.md new file mode 100644 index 00000000000000..c1c13882db7713 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_south_azerbaijani_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_south_azerbaijani_10k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_south_azerbaijani_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_south_azerbaijani_10k_en_5.4.2_3.0_1724477383040.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_south_azerbaijani_10k_en_5.4.2_3.0_1724477383040.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_south_azerbaijani_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_south_azerbaijani_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_south_azerbaijani_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-azb-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_pipeline_en.md new file mode 100644 index 00000000000000..9316178e21fe84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_south_azerbaijani_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_south_azerbaijani_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_south_azerbaijani_10k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_south_azerbaijani_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_south_azerbaijani_10k_pipeline_en_5.4.2_3.0_1724477563112.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_south_azerbaijani_10k_pipeline_en_5.4.2_3.0_1724477563112.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_south_azerbaijani_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_south_azerbaijani_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_south_azerbaijani_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-azb-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_en.md new file mode 100644 index 00000000000000..74c43804af65d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_30000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_30000_en_5.4.2_3.0_1724540084908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_30000_en_5.4.2_3.0_1724540084908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_pipeline_en.md new file mode 100644 index 00000000000000..6529eb760efda1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_squad_qg_trimmed_english_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_30000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_30000_pipeline_en_5.4.2_3.0_1724540100789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_30000_pipeline_en_5.4.2_3.0_1724540100789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qg_trimmed_english_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qg_trimmed_english_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_en.md new file mode 100644 index 00000000000000..5129670599f547 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_task2_dataset3 T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task2_dataset3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task2_dataset3` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset3_en_5.4.2_3.0_1724465739460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset3_en_5.4.2_3.0_1724465739460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_task2_dataset3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_task2_dataset3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task2_dataset3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task2-dataset3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_pipeline_en.md new file mode 100644 index 00000000000000..af8a9777bd20b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task2_dataset3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_task2_dataset3_pipeline pipeline T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task2_dataset3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task2_dataset3_pipeline` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset3_pipeline_en_5.4.2_3.0_1724465857204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset3_pipeline_en_5.4.2_3.0_1724465857204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_task2_dataset3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_task2_dataset3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task2_dataset3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task2-dataset3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_en.md new file mode 100644 index 00000000000000..11ed9af6dba6bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_task3_dataset3 T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task3_dataset3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task3_dataset3` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task3_dataset3_en_5.4.2_3.0_1724479870754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task3_dataset3_en_5.4.2_3.0_1724479870754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_task3_dataset3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_task3_dataset3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task3_dataset3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task3-dataset3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_pipeline_en.md new file mode 100644 index 00000000000000..b278c4c88704d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_task3_dataset3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_task3_dataset3_pipeline pipeline T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task3_dataset3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task3_dataset3_pipeline` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task3_dataset3_pipeline_en_5.4.2_3.0_1724479996895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task3_dataset3_pipeline_en_5.4.2_3.0_1724479996895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_task3_dataset3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_task3_dataset3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task3_dataset3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task3-dataset3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_en.md new file mode 100644 index 00000000000000..6a06e4fa17fc90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_thai_headline_simple T5Transformer from gm-akisame +author: John Snow Labs +name: mt5_small_thai_headline_simple +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_headline_simple` is a English model originally trained by gm-akisame. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_headline_simple_en_5.4.2_3.0_1724486598345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_headline_simple_en_5.4.2_3.0_1724486598345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_thai_headline_simple","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_thai_headline_simple", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_headline_simple| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/gm-akisame/mt5-small-thai-headline-simple \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_pipeline_en.md new file mode 100644 index 00000000000000..07b57e4a874730 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_headline_simple_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_thai_headline_simple_pipeline pipeline T5Transformer from gm-akisame +author: John Snow Labs +name: mt5_small_thai_headline_simple_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_headline_simple_pipeline` is a English model originally trained by gm-akisame. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_headline_simple_pipeline_en_5.4.2_3.0_1724486682522.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_headline_simple_pipeline_en_5.4.2_3.0_1724486682522.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_thai_headline_simple_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_thai_headline_simple_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_headline_simple_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/gm-akisame/mt5-small-thai-headline-simple + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_en.md new file mode 100644 index 00000000000000..8817ba5ced2af2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_thai_question_simple T5Transformer from gm-akisame +author: John Snow Labs +name: mt5_small_thai_question_simple +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_question_simple` is a English model originally trained by gm-akisame. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_question_simple_en_5.4.2_3.0_1724505022122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_question_simple_en_5.4.2_3.0_1724505022122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_thai_question_simple","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_thai_question_simple", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_question_simple| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/gm-akisame/mt5-small-thai-question-simple \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_pipeline_en.md new file mode 100644 index 00000000000000..deca2636d695a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_thai_question_simple_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_thai_question_simple_pipeline pipeline T5Transformer from gm-akisame +author: John Snow Labs +name: mt5_small_thai_question_simple_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_question_simple_pipeline` is a English model originally trained by gm-akisame. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_question_simple_pipeline_en_5.4.2_3.0_1724505109433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_question_simple_pipeline_en_5.4.2_3.0_1724505109433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_thai_question_simple_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_thai_question_simple_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_question_simple_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/gm-akisame/mt5-small-thai-question-simple + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_en.md new file mode 100644 index 00000000000000..8550d839f17e59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_french_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_10000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_en_5.4.2_3.0_1724519752199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_en_5.4.2_3.0_1724519752199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_fr.md new file mode 100644 index 00000000000000..e0cceea8600b12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_10000_frquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_10000_frquad_qg +date: 2024-08-24 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_10000_frquad_qg` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_frquad_qg_fr_5.4.2_3.0_1724467302485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_frquad_qg_fr_5.4.2_3.0_1724467302485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_10000_frquad_qg","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_10000_frquad_qg", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_10000_frquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|223.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-10000-frquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_pipeline_fr.md new file mode 100644 index 00000000000000..74b2ec7a942f7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_frquad_qg_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_10000_frquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_10000_frquad_qg_pipeline +date: 2024-08-24 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_10000_frquad_qg_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_frquad_qg_pipeline_fr_5.4.2_3.0_1724467318153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_frquad_qg_pipeline_fr_5.4.2_3.0_1724467318153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_10000_frquad_qg_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_10000_frquad_qg_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_10000_frquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|223.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-10000-frquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_pipeline_en.md new file mode 100644 index 00000000000000..956908c28db432 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_french_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_10000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_pipeline_en_5.4.2_3.0_1724519791840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_10000_pipeline_en_5.4.2_3.0_1724519791840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_fr.md new file mode 100644 index 00000000000000..841649452b9c2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_90000_frquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_90000_frquad_qa +date: 2024-08-24 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_90000_frquad_qa` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_90000_frquad_qa_fr_5.4.2_3.0_1724470479475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_90000_frquad_qa_fr_5.4.2_3.0_1724470479475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_90000_frquad_qa","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_90000_frquad_qa", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_90000_frquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|582.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-90000-frquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_pipeline_fr.md new file mode 100644 index 00000000000000..a26437c355da91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_90000_frquad_qa_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_90000_frquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_90000_frquad_qa_pipeline +date: 2024-08-24 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_90000_frquad_qa_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_90000_frquad_qa_pipeline_fr_5.4.2_3.0_1724470515711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_90000_frquad_qa_pipeline_fr_5.4.2_3.0_1724470515711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_90000_frquad_qa_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_90000_frquad_qa_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_90000_frquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|582.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-90000-frquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_fr.md new file mode 100644 index 00000000000000..26dbece9d8ce49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_frquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_frquad_qa +date: 2024-08-24 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_frquad_qa` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_frquad_qa_fr_5.4.2_3.0_1724507255196.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_frquad_qa_fr_5.4.2_3.0_1724507255196.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_frquad_qa","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_frquad_qa", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_frquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|744.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-frquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_pipeline_fr.md new file mode 100644 index 00000000000000..3bf44e8d039fea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_french_frquad_qa_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_frquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_frquad_qa_pipeline +date: 2024-08-24 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_frquad_qa_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_frquad_qa_pipeline_fr_5.4.2_3.0_1724507304502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_frquad_qa_pipeline_fr_5.4.2_3.0_1724507304502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_frquad_qa_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_frquad_qa_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_frquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|744.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-frquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_en.md new file mode 100644 index 00000000000000..cb1514f60bb668 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_italian_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_10000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_10000_en_5.4.2_3.0_1724504373451.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_10000_en_5.4.2_3.0_1724504373451.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_pipeline_en.md new file mode 100644 index 00000000000000..008f98ed083849 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_italian_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_10000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_10000_pipeline_en_5.4.2_3.0_1724504413162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_10000_pipeline_en_5.4.2_3.0_1724504413162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_it.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_it.md new file mode 100644 index 00000000000000..77a4bcfc3e7d10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_itquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_itquad_qa +date: 2024-08-24 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_itquad_qa` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_itquad_qa_it_5.4.2_3.0_1724536650236.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_itquad_qa_it_5.4.2_3.0_1724536650236.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_itquad_qa","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_itquad_qa", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_itquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|706.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-itquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_pipeline_it.md new file mode 100644 index 00000000000000..f9e139de07c19a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_italian_itquad_qa_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_itquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_itquad_qa_pipeline +date: 2024-08-24 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_itquad_qa_pipeline` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_itquad_qa_pipeline_it_5.4.2_3.0_1724536688862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_itquad_qa_pipeline_it_5.4.2_3.0_1724536688862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_itquad_qa_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_itquad_qa_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_itquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|706.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-itquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_ja.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_ja.md new file mode 100644 index 00000000000000..638dfe1627748c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_15000_jaquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_15000_jaquad_qa +date: 2024-08-24 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_15000_jaquad_qa` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_15000_jaquad_qa_ja_5.4.2_3.0_1724517962865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_15000_jaquad_qa_ja_5.4.2_3.0_1724517962865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_15000_jaquad_qa","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_15000_jaquad_qa", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_15000_jaquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|251.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-15000-jaquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline_ja.md new file mode 100644 index 00000000000000..a914410eb415b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline +date: 2024-08-24 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724517975920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724517975920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_15000_jaquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|251.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-15000-jaquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_en.md new file mode 100644 index 00000000000000..9d570ecaaba242 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_en_5.4.2_3.0_1724520956617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_en_5.4.2_3.0_1724520956617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|174.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_pipeline_en.md new file mode 100644 index 00000000000000..f46f210b9ae36a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_japanese_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_pipeline_en_5.4.2_3.0_1724521015410.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_pipeline_en_5.4.2_3.0_1724521015410.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|174.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_ko.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_ko.md new file mode 100644 index 00000000000000..7f7e6ccb6c0b44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_ko.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_15000_koquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_15000_koquad_qg +date: 2024-08-24 +tags: [ko, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_15000_koquad_qg` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_15000_koquad_qg_ko_5.4.2_3.0_1724500171585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_15000_koquad_qg_ko_5.4.2_3.0_1724500171585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_15000_koquad_qg","ko") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_15000_koquad_qg", "ko") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_15000_koquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ko| +|Size:|245.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-15000-koquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_pipeline_ko.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_pipeline_ko.md new file mode 100644 index 00000000000000..781e54489184ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_trimmed_korean_15000_koquad_qg_pipeline_ko.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_15000_koquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_15000_koquad_qg_pipeline +date: 2024-08-24 +tags: [ko, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_15000_koquad_qg_pipeline` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_15000_koquad_qg_pipeline_ko_5.4.2_3.0_1724500184651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_15000_koquad_qg_pipeline_ko_5.4.2_3.0_1724500184651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_15000_koquad_qg_pipeline", lang = "ko") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_15000_koquad_qg_pipeline", lang = "ko") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_15000_koquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ko| +|Size:|245.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-15000-koquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_en.md new file mode 100644 index 00000000000000..c09562839bbe53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tuto_mt5_small_1 T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_tuto_mt5_small_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tuto_mt5_small_1` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_1_en_5.4.2_3.0_1724531484151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_1_en_5.4.2_3.0_1724531484151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tuto_mt5_small_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tuto_mt5_small_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tuto_mt5_small_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-tuto-mt5-small-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_pipeline_en.md new file mode 100644 index 00000000000000..5b7efff6cccfeb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_tuto_mt5_small_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tuto_mt5_small_1_pipeline pipeline T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_tuto_mt5_small_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tuto_mt5_small_1_pipeline` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_1_pipeline_en_5.4.2_3.0_1724531567576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_1_pipeline_en_5.4.2_3.0_1724531567576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tuto_mt5_small_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tuto_mt5_small_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tuto_mt5_small_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-tuto-mt5-small-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_en.md new file mode 100644 index 00000000000000..36abc6455782ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_wmt16_german_english T5Transformer from chunwoolee0 +author: John Snow Labs +name: mt5_small_wmt16_german_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_wmt16_german_english` is a English model originally trained by chunwoolee0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_wmt16_german_english_en_5.4.2_3.0_1724512314443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_wmt16_german_english_en_5.4.2_3.0_1724512314443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_wmt16_german_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_wmt16_german_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_wmt16_german_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/chunwoolee0/mt5_small_wmt16_de_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_pipeline_en.md new file mode 100644 index 00000000000000..6cce33a85a57bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_small_wmt16_german_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_wmt16_german_english_pipeline pipeline T5Transformer from chunwoolee0 +author: John Snow Labs +name: mt5_small_wmt16_german_english_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_wmt16_german_english_pipeline` is a English model originally trained by chunwoolee0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_wmt16_german_english_pipeline_en_5.4.2_3.0_1724512413779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_wmt16_german_english_pipeline_en_5.4.2_3.0_1724512413779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_wmt16_german_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_wmt16_german_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_wmt16_german_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/chunwoolee0/mt5_small_wmt16_de_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_squad_v2_fin_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_squad_v2_fin_en.md new file mode 100644 index 00000000000000..4d4ef94057bb11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_squad_v2_fin_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_squad_v2_fin T5Transformer from degoeath +author: John Snow Labs +name: mt5_squad_v2_fin +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_squad_v2_fin` is a English model originally trained by degoeath. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_squad_v2_fin_en_5.4.2_3.0_1724510147757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_squad_v2_fin_en_5.4.2_3.0_1724510147757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_squad_v2_fin","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_squad_v2_fin", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_squad_v2_fin| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/degoeath/mt5-squad_v2_fin \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_en.md new file mode 100644 index 00000000000000..4c71536d551b5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summarize_russian_nepal_bhasa_version T5Transformer from doktan +author: John Snow Labs +name: mt5_summarize_russian_nepal_bhasa_version +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_russian_nepal_bhasa_version` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_nepal_bhasa_version_en_5.4.2_3.0_1724470238692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_nepal_bhasa_version_en_5.4.2_3.0_1724470238692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summarize_russian_nepal_bhasa_version","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summarize_russian_nepal_bhasa_version", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_russian_nepal_bhasa_version| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/doktan/mt5-summarize-ru-new-version \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_pipeline_en.md new file mode 100644 index 00000000000000..830b73466c767f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_summarize_russian_nepal_bhasa_version_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summarize_russian_nepal_bhasa_version_pipeline pipeline T5Transformer from doktan +author: John Snow Labs +name: mt5_summarize_russian_nepal_bhasa_version_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_russian_nepal_bhasa_version_pipeline` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_nepal_bhasa_version_pipeline_en_5.4.2_3.0_1724470334816.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_nepal_bhasa_version_pipeline_en_5.4.2_3.0_1724470334816.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summarize_russian_nepal_bhasa_version_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summarize_russian_nepal_bhasa_version_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_russian_nepal_bhasa_version_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/doktan/mt5-summarize-ru-new-version + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_en.md new file mode 100644 index 00000000000000..d234cc396aa49d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_swatf T5Transformer from n3wtou +author: John Snow Labs +name: mt5_swatf +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_swatf` is a English model originally trained by n3wtou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_swatf_en_5.4.2_3.0_1724493654516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_swatf_en_5.4.2_3.0_1724493654516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_swatf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_swatf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_swatf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/n3wtou/mt5-swatf \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_pipeline_en.md new file mode 100644 index 00000000000000..c079ca86cfc3cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_swatf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_swatf_pipeline pipeline T5Transformer from n3wtou +author: John Snow Labs +name: mt5_swatf_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_swatf_pipeline` is a English model originally trained by n3wtou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_swatf_pipeline_en_5.4.2_3.0_1724493753086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_swatf_pipeline_en_5.4.2_3.0_1724493753086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_swatf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_swatf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_swatf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/n3wtou/mt5-swatf + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_textsimp_lithuanian_batchsize8_lr5e_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_textsimp_lithuanian_batchsize8_lr5e_5_en.md new file mode 100644 index 00000000000000..05a56bc3889550 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_textsimp_lithuanian_batchsize8_lr5e_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_textsimp_lithuanian_batchsize8_lr5e_5 T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_textsimp_lithuanian_batchsize8_lr5e_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_textsimp_lithuanian_batchsize8_lr5e_5` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize8_lr5e_5_en_5.4.2_3.0_1724481768550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize8_lr5e_5_en_5.4.2_3.0_1724481768550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize8_lr5e_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize8_lr5e_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_textsimp_lithuanian_batchsize8_lr5e_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mT5-TextSimp-LT-BatchSize8-lr5e-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_en.md new file mode 100644 index 00000000000000..fb10e79ac7ecb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_translated_lithuanian_simplifier T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_translated_lithuanian_simplifier +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_translated_lithuanian_simplifier` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_translated_lithuanian_simplifier_en_5.4.2_3.0_1724492829516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_translated_lithuanian_simplifier_en_5.4.2_3.0_1724492829516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_translated_lithuanian_simplifier","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_translated_lithuanian_simplifier", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_translated_lithuanian_simplifier| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mt5-translated-lithuanian-simplifier \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_pipeline_en.md new file mode 100644 index 00000000000000..c0d711edc9a195 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_translated_lithuanian_simplifier_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_translated_lithuanian_simplifier_pipeline pipeline T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_translated_lithuanian_simplifier_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_translated_lithuanian_simplifier_pipeline` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_translated_lithuanian_simplifier_pipeline_en_5.4.2_3.0_1724492993789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_translated_lithuanian_simplifier_pipeline_en_5.4.2_3.0_1724492993789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_translated_lithuanian_simplifier_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_translated_lithuanian_simplifier_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_translated_lithuanian_simplifier_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mt5-translated-lithuanian-simplifier + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_en.md new file mode 100644 index 00000000000000..69f209650dbd41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_zh2en T5Transformer from Takq +author: John Snow Labs +name: mt5_zh2en +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_zh2en` is a English model originally trained by Takq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_zh2en_en_5.4.2_3.0_1724501837853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_zh2en_en_5.4.2_3.0_1724501837853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_zh2en","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_zh2en", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_zh2en| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/Takq/mt5-zh2en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_pipeline_en.md new file mode 100644 index 00000000000000..cac0cb2b91b473 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-mt5_zh2en_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_zh2en_pipeline pipeline T5Transformer from Takq +author: John Snow Labs +name: mt5_zh2en_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_zh2en_pipeline` is a English model originally trained by Takq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_zh2en_pipeline_en_5.4.2_3.0_1724501918281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_zh2en_pipeline_en_5.4.2_3.0_1724501918281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_zh2en_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_zh2en_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_zh2en_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/Takq/mt5-zh2en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_en.md b/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_en.md new file mode 100644 index 00000000000000..9f051fa870ef12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English multinews_model_sif10 T5Transformer from Sif10 +author: John Snow Labs +name: multinews_model_sif10 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multinews_model_sif10` is a English model originally trained by Sif10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multinews_model_sif10_en_5.4.2_3.0_1724482374296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multinews_model_sif10_en_5.4.2_3.0_1724482374296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("multinews_model_sif10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("multinews_model_sif10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multinews_model_sif10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Sif10/multinews_model_ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_pipeline_en.md new file mode 100644 index 00000000000000..f2457d79c1b198 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-multinews_model_sif10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English multinews_model_sif10_pipeline pipeline T5Transformer from Sif10 +author: John Snow Labs +name: multinews_model_sif10_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multinews_model_sif10_pipeline` is a English model originally trained by Sif10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multinews_model_sif10_pipeline_en_5.4.2_3.0_1724482423532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multinews_model_sif10_pipeline_en_5.4.2_3.0_1724482423532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("multinews_model_sif10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("multinews_model_sif10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multinews_model_sif10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Sif10/multinews_model_ + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_en.md b/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_en.md new file mode 100644 index 00000000000000..a996846358144b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nepali_news_sumamary T5Transformer from Hemg +author: John Snow Labs +name: nepali_news_sumamary +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nepali_news_sumamary` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nepali_news_sumamary_en_5.4.2_3.0_1724517415256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nepali_news_sumamary_en_5.4.2_3.0_1724517415256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nepali_news_sumamary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nepali_news_sumamary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nepali_news_sumamary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/Hemg/Nepali-News-Sumamary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_pipeline_en.md new file mode 100644 index 00000000000000..8d514aaac4d5de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-nepali_news_sumamary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nepali_news_sumamary_pipeline pipeline T5Transformer from Hemg +author: John Snow Labs +name: nepali_news_sumamary_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nepali_news_sumamary_pipeline` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nepali_news_sumamary_pipeline_en_5.4.2_3.0_1724517434606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nepali_news_sumamary_pipeline_en_5.4.2_3.0_1724517434606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nepali_news_sumamary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nepali_news_sumamary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nepali_news_sumamary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/Hemg/Nepali-News-Sumamary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_en.md b/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_en.md new file mode 100644 index 00000000000000..a5e482b01c327b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nmt_t5_wmt14_english_tonga_tonga_islands_german T5Transformer from Reyansh4 +author: John Snow Labs +name: nmt_t5_wmt14_english_tonga_tonga_islands_german +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_t5_wmt14_english_tonga_tonga_islands_german` is a English model originally trained by Reyansh4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724497143055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724497143055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nmt_t5_wmt14_english_tonga_tonga_islands_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nmt_t5_wmt14_english_tonga_tonga_islands_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_t5_wmt14_english_tonga_tonga_islands_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|992.8 MB| + +## References + +https://huggingface.co/Reyansh4/NMT_T5_wmt14_en_to_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline_en.md new file mode 100644 index 00000000000000..f9bf2029200be6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline pipeline T5Transformer from Reyansh4 +author: John Snow Labs +name: nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline` is a English model originally trained by Reyansh4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724497196641.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724497196641.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_t5_wmt14_english_tonga_tonga_islands_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.8 MB| + +## References + +https://huggingface.co/Reyansh4/NMT_T5_wmt14_en_to_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..bf77f2b790d054 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724518174690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724518174690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..630c19ed7b61d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724518192716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724518192716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..544bf41c1a73d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724541982253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724541982253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|311.4 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_shuffled_graphs_with_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..d3edc5fa06c9a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724542000216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724542000216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_shuffled_graphs_with_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|311.4 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_shuffled_graphs_with_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_en.md new file mode 100644 index 00000000000000..ccdfce0600dad8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English norwegian_sum_t5_5 T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_5` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_5_en_5.4.2_3.0_1724496541910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_5_en_5.4.2_3.0_1724496541910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("norwegian_sum_t5_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("norwegian_sum_t5_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.1 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_pipeline_en.md new file mode 100644 index 00000000000000..057a84cdef304c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-norwegian_sum_t5_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English norwegian_sum_t5_5_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_5_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_5_pipeline_en_5.4.2_3.0_1724496559798.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_5_pipeline_en_5.4.2_3.0_1724496559798.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("norwegian_sum_t5_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("norwegian_sum_t5_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.1 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_en.md b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_en.md new file mode 100644 index 00000000000000..13cc44e32be95f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v4 T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v4` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v4_en_5.4.2_3.0_1724460638612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v4_en_5.4.2_3.0_1724460638612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_pipeline_en.md new file mode 100644 index 00000000000000..643d27fc3809f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v4_pipeline pipeline T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v4_pipeline` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v4_pipeline_en_5.4.2_3.0_1724460699746.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v4_pipeline_en_5.4.2_3.0_1724460699746.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("oop_german_qg_flan_t5_base_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("oop_german_qg_flan_t5_base_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_en.md b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_en.md new file mode 100644 index 00000000000000..08a2a392390e0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v6 T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v6` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v6_en_5.4.2_3.0_1724529629007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v6_en_5.4.2_3.0_1724529629007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_pipeline_en.md new file mode 100644 index 00000000000000..1ab5ee7035f866 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-oop_german_qg_flan_t5_base_v6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v6_pipeline pipeline T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v6_pipeline` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v6_pipeline_en_5.4.2_3.0_1724529676298.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v6_pipeline_en_5.4.2_3.0_1724529676298.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("oop_german_qg_flan_t5_base_v6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("oop_german_qg_flan_t5_base_v6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_en.md new file mode 100644 index 00000000000000..c05fda300f87b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English orca_lamini_flan_t5_small T5Transformer from sachithgunasekara +author: John Snow Labs +name: orca_lamini_flan_t5_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`orca_lamini_flan_t5_small` is a English model originally trained by sachithgunasekara. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/orca_lamini_flan_t5_small_en_5.4.2_3.0_1724483524422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/orca_lamini_flan_t5_small_en_5.4.2_3.0_1724483524422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("orca_lamini_flan_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("orca_lamini_flan_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|orca_lamini_flan_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/sachithgunasekara/Orca-LaMini-flan-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..69767faecbc2b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-orca_lamini_flan_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English orca_lamini_flan_t5_small_pipeline pipeline T5Transformer from sachithgunasekara +author: John Snow Labs +name: orca_lamini_flan_t5_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`orca_lamini_flan_t5_small_pipeline` is a English model originally trained by sachithgunasekara. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/orca_lamini_flan_t5_small_pipeline_en_5.4.2_3.0_1724483540639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/orca_lamini_flan_t5_small_pipeline_en_5.4.2_3.0_1724483540639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("orca_lamini_flan_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("orca_lamini_flan_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|orca_lamini_flan_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/sachithgunasekara/Orca-LaMini-flan-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_en.md b/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_en.md new file mode 100644 index 00000000000000..805628920c5365 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English output_mayankjatav T5Transformer from MayankJatav +author: John Snow Labs +name: output_mayankjatav +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_mayankjatav` is a English model originally trained by MayankJatav. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_mayankjatav_en_5.4.2_3.0_1724501657854.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_mayankjatav_en_5.4.2_3.0_1724501657854.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("output_mayankjatav","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("output_mayankjatav", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_mayankjatav| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|975.7 MB| + +## References + +https://huggingface.co/MayankJatav/output \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_pipeline_en.md new file mode 100644 index 00000000000000..423afa3f6a652d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-output_mayankjatav_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English output_mayankjatav_pipeline pipeline T5Transformer from MayankJatav +author: John Snow Labs +name: output_mayankjatav_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_mayankjatav_pipeline` is a English model originally trained by MayankJatav. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_mayankjatav_pipeline_en_5.4.2_3.0_1724501711750.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_mayankjatav_pipeline_en_5.4.2_3.0_1724501711750.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("output_mayankjatav_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("output_mayankjatav_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_mayankjatav_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|975.7 MB| + +## References + +https://huggingface.co/MayankJatav/output + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_en.md b/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_en.md new file mode 100644 index 00000000000000..6840464951b01a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pai_wikisplit T5Transformer from seduerr +author: John Snow Labs +name: pai_wikisplit +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pai_wikisplit` is a English model originally trained by seduerr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pai_wikisplit_en_5.4.2_3.0_1724462246836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pai_wikisplit_en_5.4.2_3.0_1724462246836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pai_wikisplit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pai_wikisplit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pai_wikisplit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/seduerr/pai_wikisplit \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_pipeline_en.md new file mode 100644 index 00000000000000..163212b22922db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-pai_wikisplit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pai_wikisplit_pipeline pipeline T5Transformer from seduerr +author: John Snow Labs +name: pai_wikisplit_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pai_wikisplit_pipeline` is a English model originally trained by seduerr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pai_wikisplit_pipeline_en_5.4.2_3.0_1724462307835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pai_wikisplit_pipeline_en_5.4.2_3.0_1724462307835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pai_wikisplit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pai_wikisplit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pai_wikisplit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/seduerr/pai_wikisplit + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_en.md new file mode 100644 index 00000000000000..7eab43b84562db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English personalised_opener_t5_large T5Transformer from njvdnbus +author: John Snow Labs +name: personalised_opener_t5_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`personalised_opener_t5_large` is a English model originally trained by njvdnbus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/personalised_opener_t5_large_en_5.4.2_3.0_1724531698030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/personalised_opener_t5_large_en_5.4.2_3.0_1724531698030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("personalised_opener_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("personalised_opener_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|personalised_opener_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/njvdnbus/personalised_opener-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..1919d18b05281e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-personalised_opener_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English personalised_opener_t5_large_pipeline pipeline T5Transformer from njvdnbus +author: John Snow Labs +name: personalised_opener_t5_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`personalised_opener_t5_large_pipeline` is a English model originally trained by njvdnbus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/personalised_opener_t5_large_pipeline_en_5.4.2_3.0_1724531829102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/personalised_opener_t5_large_pipeline_en_5.4.2_3.0_1724531829102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("personalised_opener_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("personalised_opener_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|personalised_opener_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/njvdnbus/personalised_opener-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_en.md b/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_en.md new file mode 100644 index 00000000000000..5b079932a5d46b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English plm_t5_base_coin_flip T5Transformer from WENGSYX +author: John Snow Labs +name: plm_t5_base_coin_flip +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`plm_t5_base_coin_flip` is a English model originally trained by WENGSYX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/plm_t5_base_coin_flip_en_5.4.2_3.0_1724498040748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/plm_t5_base_coin_flip_en_5.4.2_3.0_1724498040748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("plm_t5_base_coin_flip","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("plm_t5_base_coin_flip", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|plm_t5_base_coin_flip| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/WENGSYX/PLM_T5_Base_coin_flip \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_pipeline_en.md new file mode 100644 index 00000000000000..e9105c28f056af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-plm_t5_base_coin_flip_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English plm_t5_base_coin_flip_pipeline pipeline T5Transformer from WENGSYX +author: John Snow Labs +name: plm_t5_base_coin_flip_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`plm_t5_base_coin_flip_pipeline` is a English model originally trained by WENGSYX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/plm_t5_base_coin_flip_pipeline_en_5.4.2_3.0_1724498091877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/plm_t5_base_coin_flip_pipeline_en_5.4.2_3.0_1724498091877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("plm_t5_base_coin_flip_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("plm_t5_base_coin_flip_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|plm_t5_base_coin_flip_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/WENGSYX/PLM_T5_Base_coin_flip + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_en.md new file mode 100644 index 00000000000000..68165f26065cc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_base_e2e_qg T5Transformer from rsgrava +author: John Snow Labs +name: ptt5_base_e2e_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_e2e_qg` is a English model originally trained by rsgrava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_e2e_qg_en_5.4.2_3.0_1724512563938.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_e2e_qg_en_5.4.2_3.0_1724512563938.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_base_e2e_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_base_e2e_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_e2e_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rsgrava/ptt5-base-e2e-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_pipeline_en.md new file mode 100644 index 00000000000000..99a7ef3be82014 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_base_e2e_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_base_e2e_qg_pipeline pipeline T5Transformer from rsgrava +author: John Snow Labs +name: ptt5_base_e2e_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_e2e_qg_pipeline` is a English model originally trained by rsgrava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_e2e_qg_pipeline_en_5.4.2_3.0_1724512615020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_e2e_qg_pipeline_en_5.4.2_3.0_1724512615020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_base_e2e_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_base_e2e_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_e2e_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rsgrava/ptt5-base-e2e-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pipeline_pt.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pipeline_pt.md new file mode 100644 index 00000000000000..10a266de8184f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pipeline_pt.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Portuguese ptt5_small_portuguese_summarizer_pipeline pipeline T5Transformer from cnmoro +author: John Snow Labs +name: ptt5_small_portuguese_summarizer_pipeline +date: 2024-08-24 +tags: [pt, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_small_portuguese_summarizer_pipeline` is a Portuguese model originally trained by cnmoro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_small_portuguese_summarizer_pipeline_pt_5.4.2_3.0_1724494122021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_small_portuguese_summarizer_pipeline_pt_5.4.2_3.0_1724494122021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_small_portuguese_summarizer_pipeline", lang = "pt") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_small_portuguese_summarizer_pipeline", lang = "pt") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_small_portuguese_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|pt| +|Size:|337.7 MB| + +## References + +https://huggingface.co/cnmoro/ptt5_small_portuguese_summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pt.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pt.md new file mode 100644 index 00000000000000..eac0a6e896db46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_small_portuguese_summarizer_pt.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Portuguese ptt5_small_portuguese_summarizer T5Transformer from cnmoro +author: John Snow Labs +name: ptt5_small_portuguese_summarizer +date: 2024-08-24 +tags: [pt, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_small_portuguese_summarizer` is a Portuguese model originally trained by cnmoro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_small_portuguese_summarizer_pt_5.4.2_3.0_1724494102966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_small_portuguese_summarizer_pt_5.4.2_3.0_1724494102966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_small_portuguese_summarizer","pt") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_small_portuguese_summarizer", "pt") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_small_portuguese_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pt| +|Size:|337.7 MB| + +## References + +https://huggingface.co/cnmoro/ptt5_small_portuguese_summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_en.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_en.md new file mode 100644 index 00000000000000..23d9c21ccb8fb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_wikilingua_temario T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_wikilingua_temario +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_wikilingua_temario` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_wikilingua_temario_en_5.4.2_3.0_1724470190190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_wikilingua_temario_en_5.4.2_3.0_1724470190190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_wikilingua_temario","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_wikilingua_temario", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_wikilingua_temario| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/arthurmluz/ptt5-wikilingua-temario \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_pipeline_en.md new file mode 100644 index 00000000000000..57d1580f4ff9ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ptt5_wikilingua_temario_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_wikilingua_temario_pipeline pipeline T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_wikilingua_temario_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_wikilingua_temario_pipeline` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_wikilingua_temario_pipeline_en_5.4.2_3.0_1724470241129.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_wikilingua_temario_pipeline_en_5.4.2_3.0_1724470241129.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_wikilingua_temario_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_wikilingua_temario_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_wikilingua_temario_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/arthurmluz/ptt5-wikilingua-temario + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_en.md b/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_en.md new file mode 100644 index 00000000000000..f1be09f010f914 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pubmedul2_tiny_nl6 T5Transformer from Siddharth63 +author: John Snow Labs +name: pubmedul2_tiny_nl6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pubmedul2_tiny_nl6` is a English model originally trained by Siddharth63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pubmedul2_tiny_nl6_en_5.4.2_3.0_1724490389617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pubmedul2_tiny_nl6_en_5.4.2_3.0_1724490389617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pubmedul2_tiny_nl6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pubmedul2_tiny_nl6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pubmedul2_tiny_nl6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|145.7 MB| + +## References + +https://huggingface.co/Siddharth63/pubmedul2-tiny-nl6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_pipeline_en.md new file mode 100644 index 00000000000000..068d38d9ff7f83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-pubmedul2_tiny_nl6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pubmedul2_tiny_nl6_pipeline pipeline T5Transformer from Siddharth63 +author: John Snow Labs +name: pubmedul2_tiny_nl6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pubmedul2_tiny_nl6_pipeline` is a English model originally trained by Siddharth63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pubmedul2_tiny_nl6_pipeline_en_5.4.2_3.0_1724490396524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pubmedul2_tiny_nl6_pipeline_en_5.4.2_3.0_1724490396524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pubmedul2_tiny_nl6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pubmedul2_tiny_nl6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pubmedul2_tiny_nl6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|145.7 MB| + +## References + +https://huggingface.co/Siddharth63/pubmedul2-tiny-nl6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_en.md b/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_en.md new file mode 100644 index 00000000000000..310c767726a2de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qcpg_dialogue_sentence T5Transformer from aleandrananu +author: John Snow Labs +name: qcpg_dialogue_sentence +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_dialogue_sentence` is a English model originally trained by aleandrananu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_dialogue_sentence_en_5.4.2_3.0_1724487060855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_dialogue_sentence_en_5.4.2_3.0_1724487060855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qcpg_dialogue_sentence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qcpg_dialogue_sentence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_dialogue_sentence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/aleandrananu/qcpg-dialogue-sentence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_pipeline_en.md new file mode 100644 index 00000000000000..12f1ac956d9590 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-qcpg_dialogue_sentence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qcpg_dialogue_sentence_pipeline pipeline T5Transformer from aleandrananu +author: John Snow Labs +name: qcpg_dialogue_sentence_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_dialogue_sentence_pipeline` is a English model originally trained by aleandrananu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_dialogue_sentence_pipeline_en_5.4.2_3.0_1724487111685.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_dialogue_sentence_pipeline_en_5.4.2_3.0_1724487111685.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qcpg_dialogue_sentence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qcpg_dialogue_sentence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_dialogue_sentence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/aleandrananu/qcpg-dialogue-sentence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_en.md new file mode 100644 index 00000000000000..b6f508a4430487 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qnli_t5_small_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: qnli_t5_small_seed_3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qnli_t5_small_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qnli_t5_small_seed_3_en_5.4.2_3.0_1724505060682.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qnli_t5_small_seed_3_en_5.4.2_3.0_1724505060682.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qnli_t5_small_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qnli_t5_small_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qnli_t5_small_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.1 MB| + +## References + +https://huggingface.co/utahnlp/qnli_t5-small_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..3af0c6da0a46f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-qnli_t5_small_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qnli_t5_small_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qnli_t5_small_seed_3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qnli_t5_small_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qnli_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724505081660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qnli_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724505081660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qnli_t5_small_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qnli_t5_small_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qnli_t5_small_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.1 MB| + +## References + +https://huggingface.co/utahnlp/qnli_t5-small_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_en.md b/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_en.md new file mode 100644 index 00000000000000..25745d72933e93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English randeng_mlt_promptcblue T5Transformer from we1kkk +author: John Snow Labs +name: randeng_mlt_promptcblue +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`randeng_mlt_promptcblue` is a English model originally trained by we1kkk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/randeng_mlt_promptcblue_en_5.4.2_3.0_1724488561822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/randeng_mlt_promptcblue_en_5.4.2_3.0_1724488561822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("randeng_mlt_promptcblue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("randeng_mlt_promptcblue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|randeng_mlt_promptcblue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/we1kkk/Randeng-MLT-PromptCBLUE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_pipeline_en.md new file mode 100644 index 00000000000000..b6e0fa515efa1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-randeng_mlt_promptcblue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English randeng_mlt_promptcblue_pipeline pipeline T5Transformer from we1kkk +author: John Snow Labs +name: randeng_mlt_promptcblue_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`randeng_mlt_promptcblue_pipeline` is a English model originally trained by we1kkk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/randeng_mlt_promptcblue_pipeline_en_5.4.2_3.0_1724488702711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/randeng_mlt_promptcblue_pipeline_en_5.4.2_3.0_1724488702711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("randeng_mlt_promptcblue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("randeng_mlt_promptcblue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|randeng_mlt_promptcblue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/we1kkk/Randeng-MLT-PromptCBLUE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_en.md new file mode 100644 index 00000000000000..a5e4a506f10e46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_100_500syn_problem_gen_t5_base T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_100_500syn_problem_gen_t5_base +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_100_500syn_problem_gen_t5_base` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_100_500syn_problem_gen_t5_base_en_5.4.2_3.0_1724459059355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_100_500syn_problem_gen_t5_base_en_5.4.2_3.0_1724459059355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_100_500syn_problem_gen_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_100_500syn_problem_gen_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_100_500syn_problem_gen_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-100-500syn-problem-gen-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..651dc16089a2b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-real_prompt_100_500syn_problem_gen_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English real_prompt_100_500syn_problem_gen_t5_base_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_100_500syn_problem_gen_t5_base_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_100_500syn_problem_gen_t5_base_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_100_500syn_problem_gen_t5_base_pipeline_en_5.4.2_3.0_1724459233320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_100_500syn_problem_gen_t5_base_pipeline_en_5.4.2_3.0_1724459233320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("real_prompt_100_500syn_problem_gen_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("real_prompt_100_500syn_problem_gen_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_100_500syn_problem_gen_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-100-500syn-problem-gen-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_en.md b/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_en.md new file mode 100644 index 00000000000000..f695c3efd37d4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_using_prompt_entity T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_using_prompt_entity +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_using_prompt_entity` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_using_prompt_entity_en_5.4.2_3.0_1724475609428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_using_prompt_entity_en_5.4.2_3.0_1724475609428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_using_prompt_entity","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_using_prompt_entity", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_using_prompt_entity| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_using_prompt_entity \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_pipeline_en.md new file mode 100644 index 00000000000000..36713721f796de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-scifive_pubmedqa_question_generation_using_prompt_entity_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_using_prompt_entity_pipeline pipeline T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_using_prompt_entity_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_using_prompt_entity_pipeline` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_using_prompt_entity_pipeline_en_5.4.2_3.0_1724475661767.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_using_prompt_entity_pipeline_en_5.4.2_3.0_1724475661767.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scifive_pubmedqa_question_generation_using_prompt_entity_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scifive_pubmedqa_question_generation_using_prompt_entity_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_using_prompt_entity_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_using_prompt_entity + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_en.md b/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_en.md new file mode 100644 index 00000000000000..705b8e8955bfae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shogi_t5 T5Transformer from pizzagatakasugi +author: John Snow Labs +name: shogi_t5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shogi_t5` is a English model originally trained by pizzagatakasugi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shogi_t5_en_5.4.2_3.0_1724536028510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shogi_t5_en_5.4.2_3.0_1724536028510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shogi_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shogi_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shogi_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pizzagatakasugi/shogi_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_pipeline_en.md new file mode 100644 index 00000000000000..e497579296a538 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shogi_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shogi_t5_pipeline pipeline T5Transformer from pizzagatakasugi +author: John Snow Labs +name: shogi_t5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shogi_t5_pipeline` is a English model originally trained by pizzagatakasugi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shogi_t5_pipeline_en_5.4.2_3.0_1724536075603.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shogi_t5_pipeline_en_5.4.2_3.0_1724536075603.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shogi_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shogi_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shogi_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pizzagatakasugi/shogi_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_en.md new file mode 100644 index 00000000000000..615097172f2fc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_en_5.4.2_3.0_1724520005416.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_en_5.4.2_3.0_1724520005416.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.4 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1_checking \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline_en.md new file mode 100644 index 00000000000000..bda0d71705d707 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline_en_5.4.2_3.0_1724520028850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline_en_5.4.2_3.0_1724520028850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.4 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1_checking + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..e8fd6d84c302de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724522954764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724522954764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..28184fe19b605f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724522972935.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724522972935.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_en.md new file mode 100644 index 00000000000000..4a081df3a0ac51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_order_nodes_without_edge_label_sentence_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_without_edge_label_sentence_level_t5_run1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_without_edge_label_sentence_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_en_5.4.2_3.0_1724468494807.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_en_5.4.2_3.0_1724468494807.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_order_nodes_without_edge_label_sentence_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_order_nodes_without_edge_label_sentence_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_without_edge_label_sentence_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_without_edge_label_sentence_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..e5f675d5b7f7a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline_en_5.4.2_3.0_1724468512815.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline_en_5.4.2_3.0_1724468512815.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_without_edge_label_sentence_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_without_edge_label_sentence_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_en.md b/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_en.md new file mode 100644 index 00000000000000..ec9dfd996a6853 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English spanish_spellchecker_flan_t5_base_wiki200000 T5Transformer from jorgeortizfuentes +author: John Snow Labs +name: spanish_spellchecker_flan_t5_base_wiki200000 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_spellchecker_flan_t5_base_wiki200000` is a English model originally trained by jorgeortizfuentes. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_spellchecker_flan_t5_base_wiki200000_en_5.4.2_3.0_1724477495326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_spellchecker_flan_t5_base_wiki200000_en_5.4.2_3.0_1724477495326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spanish_spellchecker_flan_t5_base_wiki200000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spanish_spellchecker_flan_t5_base_wiki200000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_spellchecker_flan_t5_base_wiki200000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jorgeortizfuentes/spanish-spellchecker-flan-t5-base-wiki200000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_pipeline_en.md new file mode 100644 index 00000000000000..c2f70098ad926e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-spanish_spellchecker_flan_t5_base_wiki200000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English spanish_spellchecker_flan_t5_base_wiki200000_pipeline pipeline T5Transformer from jorgeortizfuentes +author: John Snow Labs +name: spanish_spellchecker_flan_t5_base_wiki200000_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_spellchecker_flan_t5_base_wiki200000_pipeline` is a English model originally trained by jorgeortizfuentes. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_spellchecker_flan_t5_base_wiki200000_pipeline_en_5.4.2_3.0_1724477543185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_spellchecker_flan_t5_base_wiki200000_pipeline_en_5.4.2_3.0_1724477543185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spanish_spellchecker_flan_t5_base_wiki200000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spanish_spellchecker_flan_t5_base_wiki200000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_spellchecker_flan_t5_base_wiki200000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jorgeortizfuentes/spanish-spellchecker-flan-t5-base-wiki200000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_en.md b/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_en.md new file mode 100644 index 00000000000000..c6f4e73f1ec07b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English spanish_uc_modelo_npl_e3_v0 T5Transformer from JuanForeroNeme +author: John Snow Labs +name: spanish_uc_modelo_npl_e3_v0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_uc_modelo_npl_e3_v0` is a English model originally trained by JuanForeroNeme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v0_en_5.4.2_3.0_1724498260875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v0_en_5.4.2_3.0_1724498260875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spanish_uc_modelo_npl_e3_v0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spanish_uc_modelo_npl_e3_v0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_uc_modelo_npl_e3_v0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanForeroNeme/ES_UC_MODELO_NPL_E3_V0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_pipeline_en.md new file mode 100644 index 00000000000000..85160b4ace6206 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-spanish_uc_modelo_npl_e3_v0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English spanish_uc_modelo_npl_e3_v0_pipeline pipeline T5Transformer from JuanForeroNeme +author: John Snow Labs +name: spanish_uc_modelo_npl_e3_v0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_uc_modelo_npl_e3_v0_pipeline` is a English model originally trained by JuanForeroNeme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v0_pipeline_en_5.4.2_3.0_1724498309954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v0_pipeline_en_5.4.2_3.0_1724498309954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spanish_uc_modelo_npl_e3_v0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spanish_uc_modelo_npl_e3_v0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_uc_modelo_npl_e3_v0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanForeroNeme/ES_UC_MODELO_NPL_E3_V0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_en.md b/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_en.md new file mode 100644 index 00000000000000..52dcd425da4cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speech_chatgpt_flan_t5_base_encodec2instruction_prompttts T5Transformer from kuanhuggingface +author: John Snow Labs +name: speech_chatgpt_flan_t5_base_encodec2instruction_prompttts +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speech_chatgpt_flan_t5_base_encodec2instruction_prompttts` is a English model originally trained by kuanhuggingface. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_en_5.4.2_3.0_1724507139336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_en_5.4.2_3.0_1724507139336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speech_chatgpt_flan_t5_base_encodec2instruction_prompttts","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speech_chatgpt_flan_t5_base_encodec2instruction_prompttts", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speech_chatgpt_flan_t5_base_encodec2instruction_prompttts| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kuanhuggingface/speech-chatgpt-flan-t5-base-encodec2instruction-promptTTS \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline_en.md new file mode 100644 index 00000000000000..4fd37394095140 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline pipeline T5Transformer from kuanhuggingface +author: John Snow Labs +name: speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline` is a English model originally trained by kuanhuggingface. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline_en_5.4.2_3.0_1724507190281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline_en_5.4.2_3.0_1724507190281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speech_chatgpt_flan_t5_base_encodec2instruction_prompttts_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kuanhuggingface/speech-chatgpt-flan-t5-base-encodec2instruction-promptTTS + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_en.md b/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_en.md new file mode 100644 index 00000000000000..5d344fff88552b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sql_custom_model T5Transformer from shashanksingh944 +author: John Snow Labs +name: sql_custom_model +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sql_custom_model` is a English model originally trained by shashanksingh944. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sql_custom_model_en_5.4.2_3.0_1724490793299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sql_custom_model_en_5.4.2_3.0_1724490793299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sql_custom_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sql_custom_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sql_custom_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/shashanksingh944/sql-custom-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_pipeline_en.md new file mode 100644 index 00000000000000..3e794aa7b1a955 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sql_custom_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sql_custom_model_pipeline pipeline T5Transformer from shashanksingh944 +author: John Snow Labs +name: sql_custom_model_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sql_custom_model_pipeline` is a English model originally trained by shashanksingh944. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sql_custom_model_pipeline_en_5.4.2_3.0_1724490961560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sql_custom_model_pipeline_en_5.4.2_3.0_1724490961560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sql_custom_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sql_custom_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sql_custom_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/shashanksingh944/sql-custom-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_en.md b/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_en.md new file mode 100644 index 00000000000000..99a80bb1b44051 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English srbd_execution_flan_t5_base_development_kowshic T5Transformer from kowshic +author: John Snow Labs +name: srbd_execution_flan_t5_base_development_kowshic +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srbd_execution_flan_t5_base_development_kowshic` is a English model originally trained by kowshic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_development_kowshic_en_5.4.2_3.0_1724524857070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_development_kowshic_en_5.4.2_3.0_1724524857070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("srbd_execution_flan_t5_base_development_kowshic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("srbd_execution_flan_t5_base_development_kowshic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srbd_execution_flan_t5_base_development_kowshic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kowshic/srbd-execution-flan-t5-base-development \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_pipeline_en.md new file mode 100644 index 00000000000000..ae1d93b53f542d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-srbd_execution_flan_t5_base_development_kowshic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English srbd_execution_flan_t5_base_development_kowshic_pipeline pipeline T5Transformer from kowshic +author: John Snow Labs +name: srbd_execution_flan_t5_base_development_kowshic_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srbd_execution_flan_t5_base_development_kowshic_pipeline` is a English model originally trained by kowshic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_development_kowshic_pipeline_en_5.4.2_3.0_1724524907734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_development_kowshic_pipeline_en_5.4.2_3.0_1724524907734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("srbd_execution_flan_t5_base_development_kowshic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("srbd_execution_flan_t5_base_development_kowshic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srbd_execution_flan_t5_base_development_kowshic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kowshic/srbd-execution-flan-t5-base-development + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_en.md b/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_en.md new file mode 100644 index 00000000000000..e091eba056a703 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_0318_15_20epochs T5Transformer from weny22 +author: John Snow Labs +name: sum_model_0318_15_20epochs +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_0318_15_20epochs` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_0318_15_20epochs_en_5.4.2_3.0_1724458040035.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_0318_15_20epochs_en_5.4.2_3.0_1724458040035.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_0318_15_20epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_0318_15_20epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_0318_15_20epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|419.0 MB| + +## References + +https://huggingface.co/weny22/sum_model_0318_15_20epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_pipeline_en.md new file mode 100644 index 00000000000000..2272c0f4df6098 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sum_model_0318_15_20epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_0318_15_20epochs_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_0318_15_20epochs_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_0318_15_20epochs_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_0318_15_20epochs_pipeline_en_5.4.2_3.0_1724458060283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_0318_15_20epochs_pipeline_en_5.4.2_3.0_1724458060283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_0318_15_20epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_0318_15_20epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_0318_15_20epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|419.0 MB| + +## References + +https://huggingface.co/weny22/sum_model_0318_15_20epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_en.md b/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_en.md new file mode 100644 index 00000000000000..1add8bce80acb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_2r1e_3_20_extract_long_text T5Transformer from weny22 +author: John Snow Labs +name: sum_model_2r1e_3_20_extract_long_text +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_2r1e_3_20_extract_long_text` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_2r1e_3_20_extract_long_text_en_5.4.2_3.0_1724502779120.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_2r1e_3_20_extract_long_text_en_5.4.2_3.0_1724502779120.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_2r1e_3_20_extract_long_text","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_2r1e_3_20_extract_long_text", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_2r1e_3_20_extract_long_text| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|420.5 MB| + +## References + +https://huggingface.co/weny22/sum_model_2r1e_3_20_extract_long_text \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_pipeline_en.md new file mode 100644 index 00000000000000..1d13fe57335ca7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-sum_model_2r1e_3_20_extract_long_text_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_2r1e_3_20_extract_long_text_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_2r1e_3_20_extract_long_text_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_2r1e_3_20_extract_long_text_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_2r1e_3_20_extract_long_text_pipeline_en_5.4.2_3.0_1724502799577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_2r1e_3_20_extract_long_text_pipeline_en_5.4.2_3.0_1724502799577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_2r1e_3_20_extract_long_text_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_2r1e_3_20_extract_long_text_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_2r1e_3_20_extract_long_text_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|420.5 MB| + +## References + +https://huggingface.co/weny22/sum_model_2r1e_3_20_extract_long_text + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_en.md new file mode 100644 index 00000000000000..774789924e2f49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_mt5_tune_test T5Transformer from huijaekim +author: John Snow Labs +name: summarization_mt5_tune_test +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_mt5_tune_test` is a English model originally trained by huijaekim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_mt5_tune_test_en_5.4.2_3.0_1724457713479.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_mt5_tune_test_en_5.4.2_3.0_1724457713479.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_mt5_tune_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_mt5_tune_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_mt5_tune_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|952.6 MB| + +## References + +https://huggingface.co/huijaekim/summarization_mt5_tune_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_pipeline_en.md new file mode 100644 index 00000000000000..e49eaed8f24884 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarization_mt5_tune_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_mt5_tune_test_pipeline pipeline T5Transformer from huijaekim +author: John Snow Labs +name: summarization_mt5_tune_test_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_mt5_tune_test_pipeline` is a English model originally trained by huijaekim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_mt5_tune_test_pipeline_en_5.4.2_3.0_1724457771827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_mt5_tune_test_pipeline_en_5.4.2_3.0_1724457771827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_mt5_tune_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_mt5_tune_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_mt5_tune_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|952.6 MB| + +## References + +https://huggingface.co/huijaekim/summarization_mt5_tune_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_en.md new file mode 100644 index 00000000000000..df44c4642861dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_keywords_background_conclusion T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_keywords_background_conclusion +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_keywords_background_conclusion` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_background_conclusion_en_5.4.2_3.0_1724525188812.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_background_conclusion_en_5.4.2_3.0_1724525188812.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_keywords_background_conclusion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_keywords_background_conclusion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_keywords_background_conclusion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_keywords_background_conclusion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline_en.md new file mode 100644 index 00000000000000..3b8a49909aaaca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline_en_5.4.2_3.0_1724525234085.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline_en_5.4.2_3.0_1724525234085.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_keywords_background_conclusion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_keywords_background_conclusion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_en.md new file mode 100644 index 00000000000000..6c99d027b57d11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_keywords_unfaceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_keywords_unfaceted +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_keywords_unfaceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_unfaceted_en_5.4.2_3.0_1724507906409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_unfaceted_en_5.4.2_3.0_1724507906409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_keywords_unfaceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_keywords_unfaceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_keywords_unfaceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_keywords_unfaceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline_en.md new file mode 100644 index 00000000000000..af649a939b64d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline_en_5.4.2_3.0_1724507955335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline_en_5.4.2_3.0_1724507955335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_keywords_unfaceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_keywords_unfaceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t52variant_en.md b/docs/_posts/ahmedlone127/2024-08-24-t52variant_en.md new file mode 100644 index 00000000000000..be977ffef6a54a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t52variant_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t52variant T5Transformer from ishwarbb23 +author: John Snow Labs +name: t52variant +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t52variant` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t52variant_en_5.4.2_3.0_1724519024768.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t52variant_en_5.4.2_3.0_1724519024768.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t52variant","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t52variant", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t52variant| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t52variant \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t52variant_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t52variant_pipeline_en.md new file mode 100644 index 00000000000000..b632d25c70330a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t52variant_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t52variant_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: t52variant_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t52variant_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t52variant_pipeline_en_5.4.2_3.0_1724519072672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t52variant_pipeline_en_5.4.2_3.0_1724519072672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t52variant_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t52variant_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t52variant_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t52variant + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_en.md new file mode 100644 index 00000000000000..c228ed81da245c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_3m_large T5Transformer from versae +author: John Snow Labs +name: t5_3m_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3m_large_en_5.4.2_3.0_1724538162629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3m_large_en_5.4.2_3.0_1724538162629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_3m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_3m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-3m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_pipeline_en.md new file mode 100644 index 00000000000000..8ee8dbe0834f56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_3m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_3m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_3m_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3m_large_pipeline_en_5.4.2_3.0_1724538298369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3m_large_pipeline_en_5.4.2_3.0_1724538298369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_3m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_3m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-3m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_en.md new file mode 100644 index 00000000000000..2c642c51361f45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_4m_large T5Transformer from versae +author: John Snow Labs +name: t5_4m_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_4m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_4m_large_en_5.4.2_3.0_1724459357500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_4m_large_en_5.4.2_3.0_1724459357500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_4m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_4m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_4m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-4m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_pipeline_en.md new file mode 100644 index 00000000000000..4f834b709bb704 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_4m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_4m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_4m_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_4m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_4m_large_pipeline_en_5.4.2_3.0_1724459495759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_4m_large_pipeline_en_5.4.2_3.0_1724459495759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_4m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_4m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_4m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-4m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_en.md new file mode 100644 index 00000000000000..17dc0b8fcd6649 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_5m_large T5Transformer from versae +author: John Snow Labs +name: t5_5m_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_5m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_5m_large_en_5.4.2_3.0_1724535515371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_5m_large_en_5.4.2_3.0_1724535515371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_5m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_5m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_5m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-5m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_pipeline_en.md new file mode 100644 index 00000000000000..362fdb528d4cb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_5m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_5m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_5m_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_5m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_5m_large_pipeline_en_5.4.2_3.0_1724535642517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_5m_large_pipeline_en_5.4.2_3.0_1724535642517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_5m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_5m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_5m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-5m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_en.md new file mode 100644 index 00000000000000..81535b5ee177e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_9 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_9_en_5.4.2_3.0_1724506169369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_9_en_5.4.2_3.0_1724506169369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_pipeline_en.md new file mode 100644 index 00000000000000..0203decd0f4c9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2014_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_9_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_9_pipeline_en_5.4.2_3.0_1724506186339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_9_pipeline_en_5.4.2_3.0_1724506186339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_en.md new file mode 100644 index 00000000000000..da2b69f44d5c61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_2_en_5.4.2_3.0_1724460045319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_2_en_5.4.2_3.0_1724460045319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_pipeline_en.md new file mode 100644 index 00000000000000..614e8972e45598 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2015_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_2_pipeline_en_5.4.2_3.0_1724460063717.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_2_pipeline_en_5.4.2_3.0_1724460063717.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_en.md new file mode 100644 index 00000000000000..636f2a5808d749 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_9 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_9_en_5.4.2_3.0_1724493713655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_9_en_5.4.2_3.0_1724493713655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_pipeline_en.md new file mode 100644 index 00000000000000..c36427c0e38d43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2016_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_9_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_9_pipeline_en_5.4.2_3.0_1724493730465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_9_pipeline_en_5.4.2_3.0_1724493730465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_en.md new file mode 100644 index 00000000000000..c0a9de7d514a01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_0 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_0` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_0_en_5.4.2_3.0_1724458549508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_0_en_5.4.2_3.0_1724458549508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_pipeline_en.md new file mode 100644 index 00000000000000..fa120cff659e81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2019_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_0_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_0_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_0_pipeline_en_5.4.2_3.0_1724458566840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_0_pipeline_en_5.4.2_3.0_1724458566840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_en.md new file mode 100644 index 00000000000000..7dfe66aaa4703f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_0 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_0` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_0_en_5.4.2_3.0_1724502028801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_0_en_5.4.2_3.0_1724502028801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_pipeline_en.md new file mode 100644 index 00000000000000..cf8d24fc511f39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_lm_wmt_2021_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_0_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_0_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_0_pipeline_en_5.4.2_3.0_1724502045170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_0_pipeline_en_5.4.2_3.0_1724502045170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_en.md new file mode 100644 index 00000000000000..4c9d93151f05d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_1_en_5.4.2_3.0_1724517059289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_1_en_5.4.2_3.0_1724517059289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_pipeline_en.md new file mode 100644 index 00000000000000..def0a6d8e62eec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_1_pipeline_en_5.4.2_3.0_1724517087669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_1_pipeline_en_5.4.2_3.0_1724517087669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_en.md new file mode 100644 index 00000000000000..12075b5dea0bfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_6_en_5.4.2_3.0_1724479855212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_6_en_5.4.2_3.0_1724479855212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|299.6 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_pipeline_en.md new file mode 100644 index 00000000000000..a9f26cbce8f3ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2015_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_6_pipeline_en_5.4.2_3.0_1724479884498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_6_pipeline_en_5.4.2_3.0_1724479884498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|299.6 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_en.md new file mode 100644 index 00000000000000..130bc4b378ad47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_11 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_11_en_5.4.2_3.0_1724504591624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_11_en_5.4.2_3.0_1724504591624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_pipeline_en.md new file mode 100644 index 00000000000000..957799b23a4bd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_11_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_11_pipeline_en_5.4.2_3.0_1724504619231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_11_pipeline_en_5.4.2_3.0_1724504619231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_en.md new file mode 100644 index 00000000000000..7390a6901c87a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_4_en_5.4.2_3.0_1724517270937.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_4_en_5.4.2_3.0_1724517270937.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|297.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_pipeline_en.md new file mode 100644 index 00000000000000..80d5805e722d3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2016_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_4_pipeline_en_5.4.2_3.0_1724517300116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_4_pipeline_en_5.4.2_3.0_1724517300116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|297.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_en.md new file mode 100644 index 00000000000000..e31b4b53b3c1d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_7 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_7_en_5.4.2_3.0_1724535930116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_7_en_5.4.2_3.0_1724535930116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_pipeline_en.md new file mode 100644 index 00000000000000..b63f56316f20c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2017_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_7_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_7_pipeline_en_5.4.2_3.0_1724535958736.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_7_pipeline_en_5.4.2_3.0_1724535958736.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_en.md new file mode 100644 index 00000000000000..21555f7c2cf089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_10 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_10_en_5.4.2_3.0_1724526174662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_10_en_5.4.2_3.0_1724526174662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_pipeline_en.md new file mode 100644 index 00000000000000..e2d5fba391391e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2019_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_10_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_10_pipeline_en_5.4.2_3.0_1724526203858.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_10_pipeline_en_5.4.2_3.0_1724526203858.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_en.md new file mode 100644 index 00000000000000..3f2a9f45b54359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_4_en_5.4.2_3.0_1724512837681.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_4_en_5.4.2_3.0_1724512837681.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_pipeline_en.md new file mode 100644 index 00000000000000..6d693868295c14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_60m_poli_aff_2020_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_4_pipeline_en_5.4.2_3.0_1724512865190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_4_pipeline_en_5.4.2_3.0_1724512865190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2020_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2020_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_en.md new file mode 100644 index 00000000000000..708b9222fbdc66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_arabic_text_summarization_finetuned_xsum T5Transformer from AhmedAE +author: John Snow Labs +name: t5_arabic_text_summarization_finetuned_xsum +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_arabic_text_summarization_finetuned_xsum` is a English model originally trained by AhmedAE. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_arabic_text_summarization_finetuned_xsum_en_5.4.2_3.0_1724491151629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_arabic_text_summarization_finetuned_xsum_en_5.4.2_3.0_1724491151629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_arabic_text_summarization_finetuned_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_arabic_text_summarization_finetuned_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_arabic_text_summarization_finetuned_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/AhmedAE/t5-arabic-text-summarization-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_pipeline_en.md new file mode 100644 index 00000000000000..0fa030e5649d07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_arabic_text_summarization_finetuned_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_arabic_text_summarization_finetuned_xsum_pipeline pipeline T5Transformer from AhmedAE +author: John Snow Labs +name: t5_arabic_text_summarization_finetuned_xsum_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_arabic_text_summarization_finetuned_xsum_pipeline` is a English model originally trained by AhmedAE. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_arabic_text_summarization_finetuned_xsum_pipeline_en_5.4.2_3.0_1724491228019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_arabic_text_summarization_finetuned_xsum_pipeline_en_5.4.2_3.0_1724491228019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_arabic_text_summarization_finetuned_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_arabic_text_summarization_finetuned_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_arabic_text_summarization_finetuned_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/AhmedAE/t5-arabic-text-summarization-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_en.md new file mode 100644 index 00000000000000..900fe1c1f5fe0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_4352 T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_4352 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_4352` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_4352_en_5.4.2_3.0_1724512630601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_4352_en_5.4.2_3.0_1724512630601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_4352","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_4352", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_4352| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-4352 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_pipeline_en.md new file mode 100644 index 00000000000000..aef90a904bb205 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_4352_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_4352_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_4352_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_4352_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_4352_pipeline_en_5.4.2_3.0_1724512677408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_4352_pipeline_en_5.4.2_3.0_1724512677408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_4352_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_4352_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_4352_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-4352 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_en.md new file mode 100644 index 00000000000000..6b4db3558a99ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_asqa_cb T5Transformer from din0s +author: John Snow Labs +name: t5_base_asqa_cb +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_asqa_cb` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_asqa_cb_en_5.4.2_3.0_1724464969580.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_asqa_cb_en_5.4.2_3.0_1724464969580.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_asqa_cb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_asqa_cb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_asqa_cb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.7 MB| + +## References + +https://huggingface.co/din0s/t5-base-asqa-cb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_pipeline_en.md new file mode 100644 index 00000000000000..2b620043a26cb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_asqa_cb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_asqa_cb_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_base_asqa_cb_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_asqa_cb_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_asqa_cb_pipeline_en_5.4.2_3.0_1724465022314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_asqa_cb_pipeline_en_5.4.2_3.0_1724465022314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_asqa_cb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_asqa_cb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_asqa_cb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.7 MB| + +## References + +https://huggingface.co/din0s/t5-base-asqa-cb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_en.md new file mode 100644 index 00000000000000..ca48ebfbf3e8da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex4_half_from_ft_dense T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex4_half_from_ft_dense +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex4_half_from_ft_dense` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex4_half_from_ft_dense_en_5.4.2_3.0_1724489477399.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex4_half_from_ft_dense_en_5.4.2_3.0_1724489477399.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex4_half_from_ft_dense","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex4_half_from_ft_dense", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex4_half_from_ft_dense| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex4_half_from_ft_dense \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline_en.md new file mode 100644 index 00000000000000..3fdf889d565737 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724489622516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724489622516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex4_half_from_ft_dense_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex4_half_from_ft_dense + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_en.md new file mode 100644 index 00000000000000..a9a2ec3efc6a01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cnndm T5Transformer from navjordj +author: John Snow Labs +name: t5_base_cnndm +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnndm` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnndm_en_5.4.2_3.0_1724481591065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnndm_en_5.4.2_3.0_1724481591065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..8ea5b39d258ae2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cnndm_pipeline pipeline T5Transformer from navjordj +author: John Snow Labs +name: t5_base_cnndm_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnndm_pipeline` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnndm_pipeline_en_5.4.2_3.0_1724481734635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnndm_pipeline_en_5.4.2_3.0_1724481734635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_en.md new file mode 100644 index 00000000000000..0735c90ac61fc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cryptic_crosswords_def_ans T5Transformer from timhk +author: John Snow Labs +name: t5_base_cryptic_crosswords_def_ans +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cryptic_crosswords_def_ans` is a English model originally trained by timhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_def_ans_en_5.4.2_3.0_1724471988886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_def_ans_en_5.4.2_3.0_1724471988886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cryptic_crosswords_def_ans","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cryptic_crosswords_def_ans", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cryptic_crosswords_def_ans| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.3 MB| + +## References + +https://huggingface.co/timhk/t5-base_cryptic-crosswords-def-ans \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_pipeline_en.md new file mode 100644 index 00000000000000..9923efb29e1e7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_cryptic_crosswords_def_ans_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cryptic_crosswords_def_ans_pipeline pipeline T5Transformer from timhk +author: John Snow Labs +name: t5_base_cryptic_crosswords_def_ans_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cryptic_crosswords_def_ans_pipeline` is a English model originally trained by timhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_def_ans_pipeline_en_5.4.2_3.0_1724472046007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_def_ans_pipeline_en_5.4.2_3.0_1724472046007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cryptic_crosswords_def_ans_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cryptic_crosswords_def_ans_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cryptic_crosswords_def_ans_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.3 MB| + +## References + +https://huggingface.co/timhk/t5-base_cryptic-crosswords-def-ans + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_en.md new file mode 100644 index 00000000000000..859e2f73aaa1d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_data_v4_model_v1 T5Transformer from CareerNinja +author: John Snow Labs +name: t5_base_data_v4_model_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_data_v4_model_v1` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_data_v4_model_v1_en_5.4.2_3.0_1724516461051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_data_v4_model_v1_en_5.4.2_3.0_1724516461051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_data_v4_model_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_data_v4_model_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_data_v4_model_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|988.3 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Base-data-v4-model-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_pipeline_en.md new file mode 100644 index 00000000000000..e0b2768ae15e06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_data_v4_model_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_data_v4_model_v1_pipeline pipeline T5Transformer from CareerNinja +author: John Snow Labs +name: t5_base_data_v4_model_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_data_v4_model_v1_pipeline` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_data_v4_model_v1_pipeline_en_5.4.2_3.0_1724516519385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_data_v4_model_v1_pipeline_en_5.4.2_3.0_1724516519385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_data_v4_model_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_data_v4_model_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_data_v4_model_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|988.3 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Base-data-v4-model-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_en.md new file mode 100644 index 00000000000000..0817b5c76c5f90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_emojilm_komeijiforce T5Transformer from KomeijiForce +author: John Snow Labs +name: t5_base_emojilm_komeijiforce +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_emojilm_komeijiforce` is a English model originally trained by KomeijiForce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_emojilm_komeijiforce_en_5.4.2_3.0_1724460035892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_emojilm_komeijiforce_en_5.4.2_3.0_1724460035892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_emojilm_komeijiforce","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_emojilm_komeijiforce", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_emojilm_komeijiforce| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KomeijiForce/t5-base-emojilm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_pipeline_en.md new file mode 100644 index 00000000000000..ee84d40c34c992 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_emojilm_komeijiforce_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_emojilm_komeijiforce_pipeline pipeline T5Transformer from KomeijiForce +author: John Snow Labs +name: t5_base_emojilm_komeijiforce_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_emojilm_komeijiforce_pipeline` is a English model originally trained by KomeijiForce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_emojilm_komeijiforce_pipeline_en_5.4.2_3.0_1724460085679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_emojilm_komeijiforce_pipeline_en_5.4.2_3.0_1724460085679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_emojilm_komeijiforce_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_emojilm_komeijiforce_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_emojilm_komeijiforce_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KomeijiForce/t5-base-emojilm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_en.md new file mode 100644 index 00000000000000..b3815de2edc494 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_128_finetuned_squad_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_128_finetuned_squad_seed_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_128_finetuned_squad_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_seed_4_en_5.4.2_3.0_1724527527478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_seed_4_en_5.4.2_3.0_1724527527478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_128_finetuned_squad_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_128_finetuned_squad_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_128_finetuned_squad_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|947.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-128-finetuned-squad-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..3779bd59c231b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724527592418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724527592418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_128_finetuned_squad_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|947.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-128-finetuned-squad-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..2de253e3f5f278 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724517447918.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724517447918.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|931.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..05633de7cb36f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724517518525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724517518525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|931.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_en.md new file mode 100644 index 00000000000000..0d9abf4d2c0f45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724514743706.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724514743706.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|938.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..eb3cab2eebdf14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724514812049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724514812049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|938.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_en.md new file mode 100644 index 00000000000000..bf97a54550e91f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724473246781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724473246781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|939.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..739b770732d157 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724473320098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724473320098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|939.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..35d337f30503ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_seed_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_2_en_5.4.2_3.0_1724470319036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_2_en_5.4.2_3.0_1724470319036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|939.0 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..1ff9753ecd3505 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724470390328.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724470390328.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|939.0 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_en.md new file mode 100644 index 00000000000000..88126b8932519e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_fine_tuned_for_punctuation_restoration T5Transformer from shashank2123 +author: John Snow Labs +name: t5_base_fine_tuned_for_punctuation_restoration +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_fine_tuned_for_punctuation_restoration` is a English model originally trained by shashank2123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_for_punctuation_restoration_en_5.4.2_3.0_1724466051105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_for_punctuation_restoration_en_5.4.2_3.0_1724466051105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_fine_tuned_for_punctuation_restoration","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_fine_tuned_for_punctuation_restoration", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_fine_tuned_for_punctuation_restoration| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.1 MB| + +## References + +https://huggingface.co/shashank2123/t5-base-fine-tuned-for-Punctuation-Restoration \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_pipeline_en.md new file mode 100644 index 00000000000000..ccec72d32cb64b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_for_punctuation_restoration_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_fine_tuned_for_punctuation_restoration_pipeline pipeline T5Transformer from shashank2123 +author: John Snow Labs +name: t5_base_fine_tuned_for_punctuation_restoration_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_fine_tuned_for_punctuation_restoration_pipeline` is a English model originally trained by shashank2123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_for_punctuation_restoration_pipeline_en_5.4.2_3.0_1724466101662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_for_punctuation_restoration_pipeline_en_5.4.2_3.0_1724466101662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_fine_tuned_for_punctuation_restoration_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_fine_tuned_for_punctuation_restoration_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_fine_tuned_for_punctuation_restoration_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.1 MB| + +## References + +https://huggingface.co/shashank2123/t5-base-fine-tuned-for-Punctuation-Restoration + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_en.md new file mode 100644 index 00000000000000..82b53fb1e36a2a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_fine_tuned_wnut_2020_task3 T5Transformer from congcongwang +author: John Snow Labs +name: t5_base_fine_tuned_wnut_2020_task3 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_fine_tuned_wnut_2020_task3` is a English model originally trained by congcongwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_wnut_2020_task3_en_5.4.2_3.0_1724469580662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_wnut_2020_task3_en_5.4.2_3.0_1724469580662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_fine_tuned_wnut_2020_task3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_fine_tuned_wnut_2020_task3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_fine_tuned_wnut_2020_task3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|990.3 MB| + +## References + +https://huggingface.co/congcongwang/t5-base-fine-tuned-wnut-2020-task3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_pipeline_en.md new file mode 100644 index 00000000000000..18998294ee8662 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_fine_tuned_wnut_2020_task3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_fine_tuned_wnut_2020_task3_pipeline pipeline T5Transformer from congcongwang +author: John Snow Labs +name: t5_base_fine_tuned_wnut_2020_task3_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_fine_tuned_wnut_2020_task3_pipeline` is a English model originally trained by congcongwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_wnut_2020_task3_pipeline_en_5.4.2_3.0_1724469631098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_fine_tuned_wnut_2020_task3_pipeline_en_5.4.2_3.0_1724469631098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_fine_tuned_wnut_2020_task3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_fine_tuned_wnut_2020_task3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_fine_tuned_wnut_2020_task3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|990.3 MB| + +## References + +https://huggingface.co/congcongwang/t5-base-fine-tuned-wnut-2020-task3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_en.md new file mode 100644 index 00000000000000..e3f92d65ff64c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_cyrexpro T5Transformer from CyrexPro +author: John Snow Labs +name: t5_base_finetuned_cyrexpro +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_cyrexpro` is a English model originally trained by CyrexPro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_cyrexpro_en_5.4.2_3.0_1724531109485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_cyrexpro_en_5.4.2_3.0_1724531109485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_cyrexpro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_cyrexpro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_cyrexpro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|978.1 MB| + +## References + +https://huggingface.co/CyrexPro/t5-base-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_pipeline_en.md new file mode 100644 index 00000000000000..84dde3536a686b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_cyrexpro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_cyrexpro_pipeline pipeline T5Transformer from CyrexPro +author: John Snow Labs +name: t5_base_finetuned_cyrexpro_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_cyrexpro_pipeline` is a English model originally trained by CyrexPro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_cyrexpro_pipeline_en_5.4.2_3.0_1724531158186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_cyrexpro_pipeline_en_5.4.2_3.0_1724531158186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_cyrexpro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_cyrexpro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_cyrexpro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|978.1 MB| + +## References + +https://huggingface.co/CyrexPro/t5-base-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_en.md new file mode 100644 index 00000000000000..b25fcfd9404d6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_disaster_tweets T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_disaster_tweets +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_disaster_tweets` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_disaster_tweets_en_5.4.2_3.0_1724523678639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_disaster_tweets_en_5.4.2_3.0_1724523678639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_disaster_tweets","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_disaster_tweets", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_disaster_tweets| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|946.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-disaster-tweets \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_pipeline_en.md new file mode 100644 index 00000000000000..6bd544fd8889c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_disaster_tweets_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_disaster_tweets_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_disaster_tweets_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_disaster_tweets_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_disaster_tweets_pipeline_en_5.4.2_3.0_1724523741559.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_disaster_tweets_pipeline_en_5.4.2_3.0_1724523741559.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_disaster_tweets_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_disaster_tweets_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_disaster_tweets_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|946.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-disaster-tweets + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_en.md new file mode 100644 index 00000000000000..599e16da45bf4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_german T5Transformer from AntIIITD +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_german +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_german` is a English model originally trained by AntIIITD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724516186015.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724516186015.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/AntIIITD/t5-base-finetuned-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_pipeline_en.md new file mode 100644 index 00000000000000..5b484468a2c732 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_german_pipeline pipeline T5Transformer from AntIIITD +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_german_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_german_pipeline` is a English model originally trained by AntIIITD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724516363893.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724516363893.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/AntIIITD/t5-base-finetuned-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md new file mode 100644 index 00000000000000..f330c40b1399e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back T5Transformer from din0s +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_en_5.4.2_3.0_1724480084774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_en_5.4.2_3.0_1724480084774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/din0s/t5-base-finetuned-en-to-it-lrs-back \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md new file mode 100644 index 00000000000000..370dfa0cfaa436 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en_5.4.2_3.0_1724480132240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en_5.4.2_3.0_1724480132240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/din0s/t5-base-finetuned-en-to-it-lrs-back + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_en.md new file mode 100644 index 00000000000000..cb63e4551ba198 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal T5Transformer from himanshubeniwal +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_en_5.4.2_3.0_1724495470022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_en_5.4.2_3.0_1724495470022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/himanshubeniwal/t5-base-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline_en.md new file mode 100644 index 00000000000000..22ffc000303858 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline pipeline T5Transformer from himanshubeniwal +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline_en_5.4.2_3.0_1724495521865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline_en_5.4.2_3.0_1724495521865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_romanian_himanshubeniwal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/himanshubeniwal/t5-base-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_en.md new file mode 100644 index 00000000000000..89cb2b33988fbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_german_english T5Transformer from rossanez +author: John Snow Labs +name: t5_base_finetuned_german_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_german_english` is a English model originally trained by rossanez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_german_english_en_5.4.2_3.0_1724468429140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_german_english_en_5.4.2_3.0_1724468429140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_german_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_german_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_german_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.5 MB| + +## References + +https://huggingface.co/rossanez/t5-base-finetuned-de-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_pipeline_en.md new file mode 100644 index 00000000000000..084b24bf57f5d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_german_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_german_english_pipeline pipeline T5Transformer from rossanez +author: John Snow Labs +name: t5_base_finetuned_german_english_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_german_english_pipeline` is a English model originally trained by rossanez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_german_english_pipeline_en_5.4.2_3.0_1724468450604.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_german_english_pipeline_en_5.4.2_3.0_1724468450604.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_german_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_german_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_german_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.5 MB| + +## References + +https://huggingface.co/rossanez/t5-base-finetuned-de-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_en.md new file mode 100644 index 00000000000000..0cdc173ea5f6db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_squad_infilling_lr_3e_5 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_finetuned_squad_infilling_lr_3e_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_squad_infilling_lr_3e_5` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_squad_infilling_lr_3e_5_en_5.4.2_3.0_1724471077728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_squad_infilling_lr_3e_5_en_5.4.2_3.0_1724471077728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_squad_infilling_lr_3e_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_squad_infilling_lr_3e_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_squad_infilling_lr_3e_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|997.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-finetuned-squad-infilling-lr-3e-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_pipeline_en.md new file mode 100644 index 00000000000000..3dae0cb51e3117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_finetuned_squad_infilling_lr_3e_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_squad_infilling_lr_3e_5_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_finetuned_squad_infilling_lr_3e_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_squad_infilling_lr_3e_5_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_squad_infilling_lr_3e_5_pipeline_en_5.4.2_3.0_1724471128337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_squad_infilling_lr_3e_5_pipeline_en_5.4.2_3.0_1724471128337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_squad_infilling_lr_3e_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_squad_infilling_lr_3e_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_squad_infilling_lr_3e_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|997.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-finetuned-squad-infilling-lr-3e-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_en.md new file mode 100644 index 00000000000000..a5a8a240978c7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_japanese_open2ch_dialogue T5Transformer from Wataru +author: John Snow Labs +name: t5_base_japanese_open2ch_dialogue +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_open2ch_dialogue` is a English model originally trained by Wataru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_open2ch_dialogue_en_5.4.2_3.0_1724482391788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_open2ch_dialogue_en_5.4.2_3.0_1724482391788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_japanese_open2ch_dialogue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_japanese_open2ch_dialogue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_open2ch_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Wataru/T5-base-ja-open2ch-dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_pipeline_en.md new file mode 100644 index 00000000000000..6716d99be34128 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_japanese_open2ch_dialogue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_japanese_open2ch_dialogue_pipeline pipeline T5Transformer from Wataru +author: John Snow Labs +name: t5_base_japanese_open2ch_dialogue_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_open2ch_dialogue_pipeline` is a English model originally trained by Wataru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_open2ch_dialogue_pipeline_en_5.4.2_3.0_1724482440041.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_open2ch_dialogue_pipeline_en_5.4.2_3.0_1724482440041.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_japanese_open2ch_dialogue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_japanese_open2ch_dialogue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_open2ch_dialogue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Wataru/T5-base-ja-open2ch-dialogue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_en.md new file mode 100644 index 00000000000000..5edd4ebbe8a6e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_korean T5Transformer from bibekyess +author: John Snow Labs +name: t5_base_korean +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_korean` is a English model originally trained by bibekyess. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_korean_en_5.4.2_3.0_1724501133316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_korean_en_5.4.2_3.0_1724501133316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_korean","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_korean", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_korean| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|944.6 MB| + +## References + +https://huggingface.co/bibekyess/t5-base-korean \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_pipeline_en.md new file mode 100644 index 00000000000000..c52ff8c4e500fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_korean_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_korean_pipeline pipeline T5Transformer from bibekyess +author: John Snow Labs +name: t5_base_korean_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_korean_pipeline` is a English model originally trained by bibekyess. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_korean_pipeline_en_5.4.2_3.0_1724501199243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_korean_pipeline_en_5.4.2_3.0_1724501199243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_korean_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_korean_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_korean_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|944.6 MB| + +## References + +https://huggingface.co/bibekyess/t5-base-korean + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_en.md new file mode 100644 index 00000000000000..194007a0d8c5ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_medium_title_generation_strikertweny T5Transformer from strikertweny +author: John Snow Labs +name: t5_base_medium_title_generation_strikertweny +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_medium_title_generation_strikertweny` is a English model originally trained by strikertweny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_medium_title_generation_strikertweny_en_5.4.2_3.0_1724540494532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_medium_title_generation_strikertweny_en_5.4.2_3.0_1724540494532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_medium_title_generation_strikertweny","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_medium_title_generation_strikertweny", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_medium_title_generation_strikertweny| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.0 MB| + +## References + +https://huggingface.co/strikertweny/t5-base-medium-title-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_pipeline_en.md new file mode 100644 index 00000000000000..e708a078191fba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_medium_title_generation_strikertweny_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_medium_title_generation_strikertweny_pipeline pipeline T5Transformer from strikertweny +author: John Snow Labs +name: t5_base_medium_title_generation_strikertweny_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_medium_title_generation_strikertweny_pipeline` is a English model originally trained by strikertweny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_medium_title_generation_strikertweny_pipeline_en_5.4.2_3.0_1724540514358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_medium_title_generation_strikertweny_pipeline_en_5.4.2_3.0_1724540514358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_medium_title_generation_strikertweny_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_medium_title_generation_strikertweny_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_medium_title_generation_strikertweny_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.0 MB| + +## References + +https://huggingface.co/strikertweny/t5-base-medium-title-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_en.md new file mode 100644 index 00000000000000..477261dac2a9b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_moe_ex8 T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex8 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex8` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_en_5.4.2_3.0_1724526628652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_en_5.4.2_3.0_1724526628652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_moe_ex8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_moe_ex8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_pipeline_en.md new file mode 100644 index 00000000000000..7303bbf5fda170 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_moe_ex8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_moe_ex8_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex8_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex8_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_pipeline_en_5.4.2_3.0_1724526774599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_pipeline_en_5.4.2_3.0_1724526774599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_moe_ex8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_moe_ex8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_en.md new file mode 100644 index 00000000000000..8ab59c0440f8b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_aap_oficial T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aap_oficial +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aap_oficial` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_oficial_en_5.4.2_3.0_1724517690985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_oficial_en_5.4.2_3.0_1724517690985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_aap_oficial","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_aap_oficial", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aap_oficial| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aap-oficial \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_pipeline_en.md new file mode 100644 index 00000000000000..d7ffc874317919 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_qg_aap_oficial_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_aap_oficial_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aap_oficial_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aap_oficial_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_oficial_pipeline_en_5.4.2_3.0_1724517747880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_oficial_pipeline_en_5.4.2_3.0_1724517747880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_aap_oficial_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_aap_oficial_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aap_oficial_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aap-oficial + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_en.md new file mode 100644 index 00000000000000..5469dfe38273c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_amazon_electronics T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_amazon_electronics +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_amazon_electronics` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_electronics_en_5.4.2_3.0_1724486063087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_electronics_en_5.4.2_3.0_1724486063087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_amazon_electronics","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_amazon_electronics", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_amazon_electronics| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-amazon-electronics \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_pipeline_en.md new file mode 100644 index 00000000000000..3a6bb62e702493 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_bm25_amazon_electronics_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_amazon_electronics_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_amazon_electronics_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_amazon_electronics_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_electronics_pipeline_en_5.4.2_3.0_1724486116688.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_electronics_pipeline_en_5.4.2_3.0_1724486116688.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_amazon_electronics_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_amazon_electronics_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_amazon_electronics_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-amazon-electronics + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_en.md new file mode 100644 index 00000000000000..30ffbd8367b89f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_electra_all T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_electra_all +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_electra_all` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_electra_all_en_5.4.2_3.0_1724472121708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_electra_all_en_5.4.2_3.0_1724472121708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_electra_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_electra_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_electra_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-electra-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_pipeline_en.md new file mode 100644 index 00000000000000..8c7590b39e0fac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_rlhf_electra_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_electra_all_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_electra_all_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_electra_all_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_electra_all_pipeline_en_5.4.2_3.0_1724472174670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_electra_all_pipeline_en_5.4.2_3.0_1724472174670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_electra_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_electra_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_electra_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-electra-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_en.md new file mode 100644 index 00000000000000..f1cf603888d644 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsum_seed36 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsum_seed36 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsum_seed36` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsum_seed36_en_5.4.2_3.0_1724523130223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsum_seed36_en_5.4.2_3.0_1724523130223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsum_seed36","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsum_seed36", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsum_seed36| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsum-seed36 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_pipeline_en.md new file mode 100644 index 00000000000000..210e325e025a25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_samsum_seed36_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsum_seed36_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsum_seed36_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsum_seed36_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsum_seed36_pipeline_en_5.4.2_3.0_1724523176740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsum_seed36_pipeline_en_5.4.2_3.0_1724523176740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsum_seed36_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsum_seed36_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsum_seed36_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsum-seed36 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_en.md new file mode 100644 index 00000000000000..223cc6bda59c7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_snl T5Transformer from navjordj +author: John Snow Labs +name: t5_base_snl +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_snl` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_snl_en_5.4.2_3.0_1724478136384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_snl_en_5.4.2_3.0_1724478136384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_snl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_snl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_snl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-snl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_pipeline_en.md new file mode 100644 index 00000000000000..8c43287213b2c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_snl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_snl_pipeline pipeline T5Transformer from navjordj +author: John Snow Labs +name: t5_base_snl_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_snl_pipeline` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_snl_pipeline_en_5.4.2_3.0_1724478267122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_snl_pipeline_en_5.4.2_3.0_1724478267122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_snl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_snl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_snl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-snl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_en.md new file mode 100644 index 00000000000000..1b95042429c3cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_qg_default T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_default +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_default` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_default_en_5.4.2_3.0_1724462649081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_default_en_5.4.2_3.0_1724462649081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_qg_default","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_qg_default", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_default| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-default \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_pipeline_en.md new file mode 100644 index 00000000000000..4809c2cc4ff35f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_default_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_qg_default_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_default_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_default_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_default_pipeline_en_5.4.2_3.0_1724462701476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_default_pipeline_en_5.4.2_3.0_1724462701476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_qg_default_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_qg_default_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_default_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-default + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_en.md new file mode 100644 index 00000000000000..122a804da6b7f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_qg_norwegian_answer T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_norwegian_answer +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_norwegian_answer` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_answer_en_5.4.2_3.0_1724465536309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_answer_en_5.4.2_3.0_1724465536309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_qg_norwegian_answer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_qg_norwegian_answer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_norwegian_answer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-no-answer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_pipeline_en.md new file mode 100644 index 00000000000000..24b4d3f3ec63a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_answer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_qg_norwegian_answer_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_norwegian_answer_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_norwegian_answer_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_answer_pipeline_en_5.4.2_3.0_1724465587437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_answer_pipeline_en_5.4.2_3.0_1724465587437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_qg_norwegian_answer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_qg_norwegian_answer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_norwegian_answer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-no-answer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_en.md new file mode 100644 index 00000000000000..548e248dfa0e5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_qg_norwegian_paragraph T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_norwegian_paragraph +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_norwegian_paragraph` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_paragraph_en_5.4.2_3.0_1724461743261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_paragraph_en_5.4.2_3.0_1724461743261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_qg_norwegian_paragraph","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_qg_norwegian_paragraph", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_norwegian_paragraph| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-no-paragraph \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_pipeline_en.md new file mode 100644 index 00000000000000..ce1c49be581ff8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squad_qg_norwegian_paragraph_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_qg_norwegian_paragraph_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squad_qg_norwegian_paragraph_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qg_norwegian_paragraph_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_paragraph_pipeline_en_5.4.2_3.0_1724461791101.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qg_norwegian_paragraph_pipeline_en_5.4.2_3.0_1724461791101.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_qg_norwegian_paragraph_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_qg_norwegian_paragraph_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qg_norwegian_paragraph_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squad-qg-no-paragraph + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_en.md new file mode 100644 index 00000000000000..380f0e4e41114d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_en_5.4.2_3.0_1724533514469.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_en_5.4.2_3.0_1724533514469.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-vanilla-new_wiki-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline_en.md new file mode 100644 index 00000000000000..dd5643bee9b07f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline_en_5.4.2_3.0_1724533560712.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline_en_5.4.2_3.0_1724533560712.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_vanilla_nepal_bhasa_wiki_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-vanilla-new_wiki-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_en.md new file mode 100644 index 00000000000000..9d25269de0c8d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squadshifts_vanilla_reddit_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_vanilla_reddit_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_vanilla_reddit_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_reddit_qg_en_5.4.2_3.0_1724526586688.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_reddit_qg_en_5.4.2_3.0_1724526586688.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squadshifts_vanilla_reddit_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squadshifts_vanilla_reddit_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_vanilla_reddit_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-vanilla-reddit-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_pipeline_en.md new file mode 100644 index 00000000000000..f514898bdb1e51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_squadshifts_vanilla_reddit_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squadshifts_vanilla_reddit_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_vanilla_reddit_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_vanilla_reddit_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_reddit_qg_pipeline_en_5.4.2_3.0_1724526632524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_vanilla_reddit_qg_pipeline_en_5.4.2_3.0_1724526632524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squadshifts_vanilla_reddit_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squadshifts_vanilla_reddit_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_vanilla_reddit_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-vanilla-reddit-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_en.md new file mode 100644 index 00000000000000..148fdaa62bff8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_grocery_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_grocery_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_grocery_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_grocery_qg_en_5.4.2_3.0_1724495386162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_grocery_qg_en_5.4.2_3.0_1724495386162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_grocery_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_grocery_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_grocery_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-grocery-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_pipeline_en.md new file mode 100644 index 00000000000000..b76264378d294c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_subjqa_grocery_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_grocery_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_grocery_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_grocery_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_grocery_qg_pipeline_en_5.4.2_3.0_1724495435229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_grocery_qg_pipeline_en_5.4.2_3.0_1724495435229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_grocery_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_grocery_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_grocery_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-grocery-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_en.md new file mode 100644 index 00000000000000..65f96dedbb07a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tabqgen T5Transformer from saichandrapandraju +author: John Snow Labs +name: t5_base_tabqgen +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tabqgen` is a English model originally trained by saichandrapandraju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tabqgen_en_5.4.2_3.0_1724506635777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tabqgen_en_5.4.2_3.0_1724506635777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tabqgen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tabqgen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tabqgen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/saichandrapandraju/t5_base_tabqgen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_pipeline_en.md new file mode 100644 index 00000000000000..d6e72c3a3b06ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_tabqgen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tabqgen_pipeline pipeline T5Transformer from saichandrapandraju +author: John Snow Labs +name: t5_base_tabqgen_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tabqgen_pipeline` is a English model originally trained by saichandrapandraju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tabqgen_pipeline_en_5.4.2_3.0_1724506692389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tabqgen_pipeline_en_5.4.2_3.0_1724506692389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tabqgen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tabqgen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tabqgen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/saichandrapandraju/t5_base_tabqgen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_en.md new file mode 100644 index 00000000000000..e0fd24c89bf3b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_text_style_transfer_using_examples T5Transformer from Suppi123 +author: John Snow Labs +name: t5_base_text_style_transfer_using_examples +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_text_style_transfer_using_examples` is a English model originally trained by Suppi123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_text_style_transfer_using_examples_en_5.4.2_3.0_1724471983651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_text_style_transfer_using_examples_en_5.4.2_3.0_1724471983651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_text_style_transfer_using_examples","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_text_style_transfer_using_examples", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_text_style_transfer_using_examples| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suppi123/T5-Base-Text-Style-Transfer-Using-Examples \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_pipeline_en.md new file mode 100644 index 00000000000000..ab7621bd649577 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_text_style_transfer_using_examples_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_text_style_transfer_using_examples_pipeline pipeline T5Transformer from Suppi123 +author: John Snow Labs +name: t5_base_text_style_transfer_using_examples_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_text_style_transfer_using_examples_pipeline` is a English model originally trained by Suppi123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_text_style_transfer_using_examples_pipeline_en_5.4.2_3.0_1724472031875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_text_style_transfer_using_examples_pipeline_en_5.4.2_3.0_1724472031875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_text_style_transfer_using_examples_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_text_style_transfer_using_examples_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_text_style_transfer_using_examples_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suppi123/T5-Base-Text-Style-Transfer-Using-Examples + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_en.md new file mode 100644 index 00000000000000..87f2ab3e39e9fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_title_v4_swarnava T5Transformer from Swarnava +author: John Snow Labs +name: t5_base_title_v4_swarnava +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_title_v4_swarnava` is a English model originally trained by Swarnava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_title_v4_swarnava_en_5.4.2_3.0_1724491308354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_title_v4_swarnava_en_5.4.2_3.0_1724491308354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_title_v4_swarnava","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_title_v4_swarnava", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_title_v4_swarnava| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Swarnava/T5_base_title_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_pipeline_en.md new file mode 100644 index 00000000000000..1dbd0675a0fe7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_title_v4_swarnava_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_title_v4_swarnava_pipeline pipeline T5Transformer from Swarnava +author: John Snow Labs +name: t5_base_title_v4_swarnava_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_title_v4_swarnava_pipeline` is a English model originally trained by Swarnava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_title_v4_swarnava_pipeline_en_5.4.2_3.0_1724491358300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_title_v4_swarnava_pipeline_en_5.4.2_3.0_1724491358300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_title_v4_swarnava_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_title_v4_swarnava_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_title_v4_swarnava_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Swarnava/T5_base_title_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_en.md new file mode 100644 index 00000000000000..45bff3e83d1ebb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_vanilla_top_v2 T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_vanilla_top_v2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_vanilla_top_v2` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_vanilla_top_v2_en_5.4.2_3.0_1724467158857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_vanilla_top_v2_en_5.4.2_3.0_1724467158857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_vanilla_top_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_vanilla_top_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_vanilla_top_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-vanilla-top_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_pipeline_en.md new file mode 100644 index 00000000000000..1edc78bb930e9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_vanilla_top_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_vanilla_top_v2_pipeline pipeline T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_vanilla_top_v2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_vanilla_top_v2_pipeline` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_vanilla_top_v2_pipeline_en_5.4.2_3.0_1724467470008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_vanilla_top_v2_pipeline_en_5.4.2_3.0_1724467470008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_vanilla_top_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_vanilla_top_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_vanilla_top_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-vanilla-top_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_en.md new file mode 100644 index 00000000000000..5df1bf22e1a27a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_wikilarge_newsela_with_domain_adaptation T5Transformer from bogdancazan +author: John Snow Labs +name: t5_base_wikilarge_newsela_with_domain_adaptation +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_wikilarge_newsela_with_domain_adaptation` is a English model originally trained by bogdancazan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_wikilarge_newsela_with_domain_adaptation_en_5.4.2_3.0_1724459184468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_wikilarge_newsela_with_domain_adaptation_en_5.4.2_3.0_1724459184468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_wikilarge_newsela_with_domain_adaptation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_wikilarge_newsela_with_domain_adaptation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_wikilarge_newsela_with_domain_adaptation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bogdancazan/t5-base-wikilarge-newsela-with-domain-adaptation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_pipeline_en.md new file mode 100644 index 00000000000000..6e483d11709f7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_wikilarge_newsela_with_domain_adaptation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_wikilarge_newsela_with_domain_adaptation_pipeline pipeline T5Transformer from bogdancazan +author: John Snow Labs +name: t5_base_wikilarge_newsela_with_domain_adaptation_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_wikilarge_newsela_with_domain_adaptation_pipeline` is a English model originally trained by bogdancazan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_wikilarge_newsela_with_domain_adaptation_pipeline_en_5.4.2_3.0_1724459231833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_wikilarge_newsela_with_domain_adaptation_pipeline_en_5.4.2_3.0_1724459231833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_wikilarge_newsela_with_domain_adaptation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_wikilarge_newsela_with_domain_adaptation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_wikilarge_newsela_with_domain_adaptation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bogdancazan/t5-base-wikilarge-newsela-with-domain-adaptation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_en.md new file mode 100644 index 00000000000000..bebfeafcfe7e1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_with_title_multi_english_wiki_news_airklizz T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_with_title_multi_english_wiki_news_airklizz +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_english_wiki_news_airklizz` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_english_wiki_news_airklizz_en_5.4.2_3.0_1724465000446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_english_wiki_news_airklizz_en_5.4.2_3.0_1724465000446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_with_title_multi_english_wiki_news_airklizz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_with_title_multi_english_wiki_news_airklizz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_english_wiki_news_airklizz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/airKlizz/t5-base-with-title-multi-en-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_pipeline_en.md new file mode 100644 index 00000000000000..011e63230d894d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_english_wiki_news_airklizz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_with_title_multi_english_wiki_news_airklizz_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_with_title_multi_english_wiki_news_airklizz_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_english_wiki_news_airklizz_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_english_wiki_news_airklizz_pipeline_en_5.4.2_3.0_1724465051682.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_english_wiki_news_airklizz_pipeline_en_5.4.2_3.0_1724465051682.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_with_title_multi_english_wiki_news_airklizz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_with_title_multi_english_wiki_news_airklizz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_english_wiki_news_airklizz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/airKlizz/t5-base-with-title-multi-en-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_fr.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_fr.md new file mode 100644 index 00000000000000..4d0a689b6088e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French t5_base_with_title_multi_french_wiki_news T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_with_title_multi_french_wiki_news +date: 2024-08-24 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_french_wiki_news` is a French model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_fr_5.4.2_3.0_1724469760331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_fr_5.4.2_3.0_1724469760331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_with_title_multi_french_wiki_news","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_with_title_multi_french_wiki_news", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_french_wiki_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|999.1 MB| + +## References + +https://huggingface.co/airKlizz/t5-base-with-title-multi-fr-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_pipeline_fr.md new file mode 100644 index 00000000000000..2fdbbb13acc784 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_base_with_title_multi_french_wiki_news_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French t5_base_with_title_multi_french_wiki_news_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_with_title_multi_french_wiki_news_pipeline +date: 2024-08-24 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_french_wiki_news_pipeline` is a French model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_pipeline_fr_5.4.2_3.0_1724469811900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_pipeline_fr_5.4.2_3.0_1724469811900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_with_title_multi_french_wiki_news_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_with_title_multi_french_wiki_news_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_french_wiki_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|999.1 MB| + +## References + +https://huggingface.co/airKlizz/t5-base-with-title-multi-fr-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_caser_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_caser_en.md new file mode 100644 index 00000000000000..3333dc45f90411 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_caser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_caser T5Transformer from XvKuoMing +author: John Snow Labs +name: t5_caser +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_caser` is a English model originally trained by XvKuoMing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_caser_en_5.4.2_3.0_1724528270780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_caser_en_5.4.2_3.0_1724528270780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_caser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_caser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_caser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/XvKuoMing/t5-caser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_caser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_caser_pipeline_en.md new file mode 100644 index 00000000000000..1fe9bea1d5ea50 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_caser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_caser_pipeline pipeline T5Transformer from XvKuoMing +author: John Snow Labs +name: t5_caser_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_caser_pipeline` is a English model originally trained by XvKuoMing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_caser_pipeline_en_5.4.2_3.0_1724528316603.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_caser_pipeline_en_5.4.2_3.0_1724528316603.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_caser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_caser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_caser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/XvKuoMing/t5-caser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_en.md new file mode 100644 index 00000000000000..1cc9f1ddd37ba4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_large_nl20 T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_nl20 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_nl20` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_nl20_en_5.4.2_3.0_1724478738995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_nl20_en_5.4.2_3.0_1724478738995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_large_nl20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_nl20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_nl20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-nl20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_pipeline_en.md new file mode 100644 index 00000000000000..a99860fe76236c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_large_nl20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_large_nl20_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_nl20_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_nl20_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_nl20_pipeline_en_5.4.2_3.0_1724479162965.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_nl20_pipeline_en_5.4.2_3.0_1724479162965.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_large_nl20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_large_nl20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_nl20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-nl20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_en.md new file mode 100644 index 00000000000000..b43f376f230f0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_tiny_finetuned_flant5_english T5Transformer from SouthMemphis +author: John Snow Labs +name: t5_efficient_tiny_finetuned_flant5_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_tiny_finetuned_flant5_english` is a English model originally trained by SouthMemphis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_finetuned_flant5_english_en_5.4.2_3.0_1724532069378.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_finetuned_flant5_english_en_5.4.2_3.0_1724532069378.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_tiny_finetuned_flant5_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_tiny_finetuned_flant5_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_tiny_finetuned_flant5_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/SouthMemphis/t5-efficient-tiny-finetuned-flant5-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_pipeline_en.md new file mode 100644 index 00000000000000..bc542030ae5ba3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_efficient_tiny_finetuned_flant5_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_tiny_finetuned_flant5_english_pipeline pipeline T5Transformer from SouthMemphis +author: John Snow Labs +name: t5_efficient_tiny_finetuned_flant5_english_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_tiny_finetuned_flant5_english_pipeline` is a English model originally trained by SouthMemphis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_finetuned_flant5_english_pipeline_en_5.4.2_3.0_1724532075605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_finetuned_flant5_english_pipeline_en_5.4.2_3.0_1724532075605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_tiny_finetuned_flant5_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_tiny_finetuned_flant5_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_tiny_finetuned_flant5_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/SouthMemphis/t5-efficient-tiny-finetuned-flant5-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_en.md new file mode 100644 index 00000000000000..911a2d9cfea47a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_empatheticdialogues T5Transformer from benjaminbeilharz +author: John Snow Labs +name: t5_empatheticdialogues +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_empatheticdialogues` is a English model originally trained by benjaminbeilharz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_empatheticdialogues_en_5.4.2_3.0_1724500921911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_empatheticdialogues_en_5.4.2_3.0_1724500921911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_empatheticdialogues","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_empatheticdialogues", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_empatheticdialogues| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/benjaminbeilharz/t5-empatheticdialogues \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_pipeline_en.md new file mode 100644 index 00000000000000..70ca1827f7dad5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_empatheticdialogues_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_empatheticdialogues_pipeline pipeline T5Transformer from benjaminbeilharz +author: John Snow Labs +name: t5_empatheticdialogues_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_empatheticdialogues_pipeline` is a English model originally trained by benjaminbeilharz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_empatheticdialogues_pipeline_en_5.4.2_3.0_1724500973322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_empatheticdialogues_pipeline_en_5.4.2_3.0_1724500973322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_empatheticdialogues_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_empatheticdialogues_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_empatheticdialogues_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/benjaminbeilharz/t5-empatheticdialogues + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_en.md new file mode 100644 index 00000000000000..8d23655ba609ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fine_poli T5Transformer from ChandlerU11 +author: John Snow Labs +name: t5_fine_poli +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_poli` is a English model originally trained by ChandlerU11. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_poli_en_5.4.2_3.0_1724484303461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_poli_en_5.4.2_3.0_1724484303461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fine_poli","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fine_poli", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_poli| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ChandlerU11/t5_fine_poli \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_pipeline_en.md new file mode 100644 index 00000000000000..45972bb40762cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_poli_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fine_poli_pipeline pipeline T5Transformer from ChandlerU11 +author: John Snow Labs +name: t5_fine_poli_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_poli_pipeline` is a English model originally trained by ChandlerU11. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_poli_pipeline_en_5.4.2_3.0_1724484323371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_poli_pipeline_en_5.4.2_3.0_1724484323371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fine_poli_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fine_poli_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_poli_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ChandlerU11/t5_fine_poli + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_en.md new file mode 100644 index 00000000000000..ace41d0999908e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fine_tune_jaychiu T5Transformer from jaychiu +author: John Snow Labs +name: t5_fine_tune_jaychiu +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tune_jaychiu` is a English model originally trained by jaychiu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tune_jaychiu_en_5.4.2_3.0_1724538241140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tune_jaychiu_en_5.4.2_3.0_1724538241140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fine_tune_jaychiu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fine_tune_jaychiu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tune_jaychiu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/jaychiu/t5-fine-tune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_pipeline_en.md new file mode 100644 index 00000000000000..3406d8b7391911 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_fine_tune_jaychiu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fine_tune_jaychiu_pipeline pipeline T5Transformer from jaychiu +author: John Snow Labs +name: t5_fine_tune_jaychiu_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tune_jaychiu_pipeline` is a English model originally trained by jaychiu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tune_jaychiu_pipeline_en_5.4.2_3.0_1724538293251.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tune_jaychiu_pipeline_en_5.4.2_3.0_1724538293251.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fine_tune_jaychiu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fine_tune_jaychiu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tune_jaychiu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/jaychiu/t5-fine-tune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_en.md new file mode 100644 index 00000000000000..12ea370831e860 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetune_health T5Transformer from la-min +author: John Snow Labs +name: t5_finetune_health +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_health` is a English model originally trained by la-min. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_health_en_5.4.2_3.0_1724464848293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_health_en_5.4.2_3.0_1724464848293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetune_health","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetune_health", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_health| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/la-min/t5-finetune-health \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_pipeline_en.md new file mode 100644 index 00000000000000..cc8dfee35315e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_health_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetune_health_pipeline pipeline T5Transformer from la-min +author: John Snow Labs +name: t5_finetune_health_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_health_pipeline` is a English model originally trained by la-min. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_health_pipeline_en_5.4.2_3.0_1724464896550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_health_pipeline_en_5.4.2_3.0_1724464896550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetune_health_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetune_health_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_health_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/la-min/t5-finetune-health + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_en.md new file mode 100644 index 00000000000000..7c5728dad68134 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetune_summarization T5Transformer from sriramahesh2000 +author: John Snow Labs +name: t5_finetune_summarization +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_summarization` is a English model originally trained by sriramahesh2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_summarization_en_5.4.2_3.0_1724482789862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_summarization_en_5.4.2_3.0_1724482789862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetune_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetune_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.1 MB| + +## References + +https://huggingface.co/sriramahesh2000/T5-finetune-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_pipeline_en.md new file mode 100644 index 00000000000000..49b1ad7c146a2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetune_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetune_summarization_pipeline pipeline T5Transformer from sriramahesh2000 +author: John Snow Labs +name: t5_finetune_summarization_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_summarization_pipeline` is a English model originally trained by sriramahesh2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_summarization_pipeline_en_5.4.2_3.0_1724482807515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_summarization_pipeline_en_5.4.2_3.0_1724482807515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetune_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetune_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.1 MB| + +## References + +https://huggingface.co/sriramahesh2000/T5-finetune-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_en.md new file mode 100644 index 00000000000000..a7823fe5a9dcfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_question_tonga_tonga_islands_answer T5Transformer from mdara +author: John Snow Labs +name: t5_finetuned_question_tonga_tonga_islands_answer +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_question_tonga_tonga_islands_answer` is a English model originally trained by mdara. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_question_tonga_tonga_islands_answer_en_5.4.2_3.0_1724523722385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_question_tonga_tonga_islands_answer_en_5.4.2_3.0_1724523722385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_question_tonga_tonga_islands_answer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_question_tonga_tonga_islands_answer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_question_tonga_tonga_islands_answer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|364.7 MB| + +## References + +https://huggingface.co/mdara/T5-finetuned-question-to-answer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md new file mode 100644 index 00000000000000..419cded927d1b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_finetuned_question_tonga_tonga_islands_answer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_question_tonga_tonga_islands_answer_pipeline pipeline T5Transformer from mdara +author: John Snow Labs +name: t5_finetuned_question_tonga_tonga_islands_answer_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_question_tonga_tonga_islands_answer_pipeline` is a English model originally trained by mdara. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_question_tonga_tonga_islands_answer_pipeline_en_5.4.2_3.0_1724523747673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_question_tonga_tonga_islands_answer_pipeline_en_5.4.2_3.0_1724523747673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_question_tonga_tonga_islands_answer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_question_tonga_tonga_islands_answer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_question_tonga_tonga_islands_answer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|364.7 MB| + +## References + +https://huggingface.co/mdara/T5-finetuned-question-to-answer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_en.md new file mode 100644 index 00000000000000..174d4c5f48e4d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_grammar269k_model T5Transformer from kalobiralo +author: John Snow Labs +name: t5_grammar269k_model +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar269k_model` is a English model originally trained by kalobiralo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar269k_model_en_5.4.2_3.0_1724468240594.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar269k_model_en_5.4.2_3.0_1724468240594.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_grammar269k_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_grammar269k_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar269k_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kalobiralo/t5-grammar269k-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_pipeline_en.md new file mode 100644 index 00000000000000..254a364cc8dc05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar269k_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_grammar269k_model_pipeline pipeline T5Transformer from kalobiralo +author: John Snow Labs +name: t5_grammar269k_model_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar269k_model_pipeline` is a English model originally trained by kalobiralo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar269k_model_pipeline_en_5.4.2_3.0_1724468293428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar269k_model_pipeline_en_5.4.2_3.0_1724468293428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_grammar269k_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_grammar269k_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar269k_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kalobiralo/t5-grammar269k-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_en.md new file mode 100644 index 00000000000000..a83316ffd978fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_grammar_nova T5Transformer from nehathorat +author: John Snow Labs +name: t5_grammar_nova +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_nova` is a English model originally trained by nehathorat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_nova_en_5.4.2_3.0_1724470796886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_nova_en_5.4.2_3.0_1724470796886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_grammar_nova","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_grammar_nova", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_nova| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|995.2 MB| + +## References + +https://huggingface.co/nehathorat/T5_Grammar_Nova \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_pipeline_en.md new file mode 100644 index 00000000000000..0c5a4fa5a497eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_grammar_nova_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_grammar_nova_pipeline pipeline T5Transformer from nehathorat +author: John Snow Labs +name: t5_grammar_nova_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_nova_pipeline` is a English model originally trained by nehathorat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_nova_pipeline_en_5.4.2_3.0_1724470849985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_nova_pipeline_en_5.4.2_3.0_1724470849985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_grammar_nova_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_grammar_nova_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_nova_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|995.2 MB| + +## References + +https://huggingface.co/nehathorat/T5_Grammar_Nova + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_en.md new file mode 100644 index 00000000000000..82976af0e954d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_claim T5Transformer from erbacher +author: John Snow Labs +name: t5_large_claim +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_claim` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_claim_en_5.4.2_3.0_1724542968856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_claim_en_5.4.2_3.0_1724542968856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_claim","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_claim", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_claim| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/erbacher/t5-large-claim \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_pipeline_en.md new file mode 100644 index 00000000000000..5a659c6c6efe0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_claim_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_claim_pipeline pipeline T5Transformer from erbacher +author: John Snow Labs +name: t5_large_claim_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_claim_pipeline` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_claim_pipeline_en_5.4.2_3.0_1724543113512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_claim_pipeline_en_5.4.2_3.0_1724543113512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_claim_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_claim_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_claim_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/erbacher/t5-large-claim + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_en.md new file mode 100644 index 00000000000000..660b6c5bba38cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_cnndm_kssteven T5Transformer from kssteven +author: John Snow Labs +name: t5_large_cnndm_kssteven +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_cnndm_kssteven` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_cnndm_kssteven_en_5.4.2_3.0_1724500672591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_cnndm_kssteven_en_5.4.2_3.0_1724500672591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_cnndm_kssteven","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_cnndm_kssteven", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_cnndm_kssteven| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kssteven/T5-large-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_pipeline_en.md new file mode 100644 index 00000000000000..7807c0e0b432c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_cnndm_kssteven_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_cnndm_kssteven_pipeline pipeline T5Transformer from kssteven +author: John Snow Labs +name: t5_large_cnndm_kssteven_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_cnndm_kssteven_pipeline` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_cnndm_kssteven_pipeline_en_5.4.2_3.0_1724500823263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_cnndm_kssteven_pipeline_en_5.4.2_3.0_1724500823263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_cnndm_kssteven_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_cnndm_kssteven_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_cnndm_kssteven_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kssteven/T5-large-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_en.md new file mode 100644 index 00000000000000..fd400cfdd3a72a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_creole_english T5Transformer from daynauth +author: John Snow Labs +name: t5_large_creole_english +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_creole_english` is a English model originally trained by daynauth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_creole_english_en_5.4.2_3.0_1724481399932.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_creole_english_en_5.4.2_3.0_1724481399932.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_creole_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_creole_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_creole_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/daynauth/t5-large-creole-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_pipeline_en.md new file mode 100644 index 00000000000000..28c5effb3ad13b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_creole_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_creole_english_pipeline pipeline T5Transformer from daynauth +author: John Snow Labs +name: t5_large_creole_english_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_creole_english_pipeline` is a English model originally trained by daynauth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_creole_english_pipeline_en_5.4.2_3.0_1724481553559.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_creole_english_pipeline_en_5.4.2_3.0_1724481553559.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_creole_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_creole_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_creole_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/daynauth/t5-large-creole-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_en.md new file mode 100644 index 00000000000000..4dd7ea4d1d7669 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_hoax_timestamp_classifier_v1 T5Transformer from research-dump +author: John Snow Labs +name: t5_large_hoax_timestamp_classifier_v1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_hoax_timestamp_classifier_v1` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_hoax_timestamp_classifier_v1_en_5.4.2_3.0_1724484894707.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_hoax_timestamp_classifier_v1_en_5.4.2_3.0_1724484894707.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_hoax_timestamp_classifier_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_hoax_timestamp_classifier_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_hoax_timestamp_classifier_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-dump/t5-large_hoax_timestamp_classifier_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_pipeline_en.md new file mode 100644 index 00000000000000..0fe195098aabd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_hoax_timestamp_classifier_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_hoax_timestamp_classifier_v1_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: t5_large_hoax_timestamp_classifier_v1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_hoax_timestamp_classifier_v1_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_hoax_timestamp_classifier_v1_pipeline_en_5.4.2_3.0_1724485043188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_hoax_timestamp_classifier_v1_pipeline_en_5.4.2_3.0_1724485043188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_hoax_timestamp_classifier_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_hoax_timestamp_classifier_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_hoax_timestamp_classifier_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-dump/t5-large_hoax_timestamp_classifier_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_en.md new file mode 100644 index 00000000000000..fe056fccb58327 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_iirc_gold T5Transformer from StonyBrookNLP +author: John Snow Labs +name: t5_large_iirc_gold +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_iirc_gold` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_iirc_gold_en_5.4.2_3.0_1724527061395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_iirc_gold_en_5.4.2_3.0_1724527061395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_iirc_gold","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_iirc_gold", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_iirc_gold| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/t5-large-iirc-gold \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_pipeline_en.md new file mode 100644 index 00000000000000..0d12f731afc233 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_iirc_gold_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_iirc_gold_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: t5_large_iirc_gold_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_iirc_gold_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_iirc_gold_pipeline_en_5.4.2_3.0_1724527209837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_iirc_gold_pipeline_en_5.4.2_3.0_1724527209837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_iirc_gold_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_iirc_gold_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_iirc_gold_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/t5-large-iirc-gold + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_en.md new file mode 100644 index 00000000000000..d9dfacb50e7d94 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_squadshifts_nepal_bhasa_wiki_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squadshifts_nepal_bhasa_wiki_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squadshifts_nepal_bhasa_wiki_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_nepal_bhasa_wiki_qg_en_5.4.2_3.0_1724483412216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_nepal_bhasa_wiki_qg_en_5.4.2_3.0_1724483412216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_squadshifts_nepal_bhasa_wiki_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_squadshifts_nepal_bhasa_wiki_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squadshifts_nepal_bhasa_wiki_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squadshifts-new_wiki-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline_en.md new file mode 100644 index 00000000000000..1a760e8a584c65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline_en_5.4.2_3.0_1724483547907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline_en_5.4.2_3.0_1724483547907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squadshifts_nepal_bhasa_wiki_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squadshifts-new_wiki-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_en.md new file mode 100644 index 00000000000000..88025ec05bf5a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_t5large_english_tonga_tonga_islands_bash T5Transformer from Josh98 +author: John Snow Labs +name: t5_large_t5large_english_tonga_tonga_islands_bash +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_t5large_english_tonga_tonga_islands_bash` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_t5large_english_tonga_tonga_islands_bash_en_5.4.2_3.0_1724463350163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_t5large_english_tonga_tonga_islands_bash_en_5.4.2_3.0_1724463350163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_t5large_english_tonga_tonga_islands_bash","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_t5large_english_tonga_tonga_islands_bash", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_t5large_english_tonga_tonga_islands_bash| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Josh98/t5-large-t5large-English-to-BASH \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_pipeline_en.md new file mode 100644 index 00000000000000..f11a96d79294b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_t5large_english_tonga_tonga_islands_bash_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_t5large_english_tonga_tonga_islands_bash_pipeline pipeline T5Transformer from Josh98 +author: John Snow Labs +name: t5_large_t5large_english_tonga_tonga_islands_bash_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_t5large_english_tonga_tonga_islands_bash_pipeline` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_t5large_english_tonga_tonga_islands_bash_pipeline_en_5.4.2_3.0_1724463484200.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_t5large_english_tonga_tonga_islands_bash_pipeline_en_5.4.2_3.0_1724463484200.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_t5large_english_tonga_tonga_islands_bash_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_t5large_english_tonga_tonga_islands_bash_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_t5large_english_tonga_tonga_islands_bash_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Josh98/t5-large-t5large-English-to-BASH + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_en.md new file mode 100644 index 00000000000000..ffafbb94986964 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_tweetqa_qag T5Transformer from lmqg +author: John Snow Labs +name: t5_large_tweetqa_qag +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_tweetqa_qag` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qag_en_5.4.2_3.0_1724460989899.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qag_en_5.4.2_3.0_1724460989899.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_tweetqa_qag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_tweetqa_qag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_tweetqa_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-tweetqa-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_pipeline_en.md new file mode 100644 index 00000000000000..1cc8d8f869bc0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_tweetqa_qag_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_tweetqa_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_large_tweetqa_qag_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_tweetqa_qag_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qag_pipeline_en_5.4.2_3.0_1724461140906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qag_pipeline_en_5.4.2_3.0_1724461140906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_tweetqa_qag_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_tweetqa_qag_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_tweetqa_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-tweetqa-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_en.md new file mode 100644 index 00000000000000..59ed8760695a1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_wsc T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_wsc +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_wsc` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_wsc_en_5.4.2_3.0_1724521903583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_wsc_en_5.4.2_3.0_1724521903583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_wsc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_wsc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_wsc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-wsc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_pipeline_en.md new file mode 100644 index 00000000000000..886c9049d1f68e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_wsc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_wsc_pipeline pipeline T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_wsc_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_wsc_pipeline` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_wsc_pipeline_en_5.4.2_3.0_1724522054534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_wsc_pipeline_en_5.4.2_3.0_1724522054534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_wsc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_wsc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_wsc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-wsc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_en.md new file mode 100644 index 00000000000000..1bfc088d5ab8fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_xsum_cnn_8_2 T5Transformer from sysresearch101 +author: John Snow Labs +name: t5_large_xsum_cnn_8_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_xsum_cnn_8_2` is a English model originally trained by sysresearch101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_xsum_cnn_8_2_en_5.4.2_3.0_1724499257837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_xsum_cnn_8_2_en_5.4.2_3.0_1724499257837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_xsum_cnn_8_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_xsum_cnn_8_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_xsum_cnn_8_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sysresearch101/t5-large-xsum-cnn-8-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_pipeline_en.md new file mode 100644 index 00000000000000..20200d38762bad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_large_xsum_cnn_8_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_xsum_cnn_8_2_pipeline pipeline T5Transformer from sysresearch101 +author: John Snow Labs +name: t5_large_xsum_cnn_8_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_xsum_cnn_8_2_pipeline` is a English model originally trained by sysresearch101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_xsum_cnn_8_2_pipeline_en_5.4.2_3.0_1724499394316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_xsum_cnn_8_2_pipeline_en_5.4.2_3.0_1724499394316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_xsum_cnn_8_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_xsum_cnn_8_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_xsum_cnn_8_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sysresearch101/t5-large-xsum-cnn-8-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_en.md new file mode 100644 index 00000000000000..dbe02947d389d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_feedback_0510 T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_0510 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_0510` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0510_en_5.4.2_3.0_1724494956968.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0510_en_5.4.2_3.0_1724494956968.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_feedback_0510","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_feedback_0510", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_0510| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|975.9 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-0510 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_pipeline_en.md new file mode 100644 index 00000000000000..6deee83c437e9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_model_1_feedback_0510_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_feedback_0510_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_0510_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_0510_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0510_pipeline_en_5.4.2_3.0_1724495015884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_0510_pipeline_en_5.4.2_3.0_1724495015884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_feedback_0510_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_feedback_0510_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_0510_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|975.9 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-0510 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_en.md new file mode 100644 index 00000000000000..78b6ab89e2ee1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_news_summarizer_hannahisrael03 T5Transformer from hannahisrael03 +author: John Snow Labs +name: t5_news_summarizer_hannahisrael03 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_news_summarizer_hannahisrael03` is a English model originally trained by hannahisrael03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_news_summarizer_hannahisrael03_en_5.4.2_3.0_1724464663648.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_news_summarizer_hannahisrael03_en_5.4.2_3.0_1724464663648.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_news_summarizer_hannahisrael03","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_news_summarizer_hannahisrael03", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_news_summarizer_hannahisrael03| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.4 MB| + +## References + +https://huggingface.co/hannahisrael03/t5_news_summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_pipeline_en.md new file mode 100644 index 00000000000000..21000ff6e0a14d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_news_summarizer_hannahisrael03_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_news_summarizer_hannahisrael03_pipeline pipeline T5Transformer from hannahisrael03 +author: John Snow Labs +name: t5_news_summarizer_hannahisrael03_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_news_summarizer_hannahisrael03_pipeline` is a English model originally trained by hannahisrael03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_news_summarizer_hannahisrael03_pipeline_en_5.4.2_3.0_1724464683879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_news_summarizer_hannahisrael03_pipeline_en_5.4.2_3.0_1724464683879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_news_summarizer_hannahisrael03_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_news_summarizer_hannahisrael03_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_news_summarizer_hannahisrael03_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.4 MB| + +## References + +https://huggingface.co/hannahisrael03/t5_news_summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_en.md new file mode 100644 index 00000000000000..85c119ad00cccf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ocr_aug_small T5Transformer from lowem1 +author: John Snow Labs +name: t5_ocr_aug_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ocr_aug_small` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ocr_aug_small_en_5.4.2_3.0_1724529366660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ocr_aug_small_en_5.4.2_3.0_1724529366660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ocr_aug_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ocr_aug_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ocr_aug_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/lowem1/t5_ocr_aug-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_pipeline_en.md new file mode 100644 index 00000000000000..d424707a566ad2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_ocr_aug_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ocr_aug_small_pipeline pipeline T5Transformer from lowem1 +author: John Snow Labs +name: t5_ocr_aug_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ocr_aug_small_pipeline` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ocr_aug_small_pipeline_en_5.4.2_3.0_1724529385434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ocr_aug_small_pipeline_en_5.4.2_3.0_1724529385434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ocr_aug_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ocr_aug_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ocr_aug_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/lowem1/t5_ocr_aug-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_en.md new file mode 100644 index 00000000000000..f14f3fbef7f55a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_para_paragon_analytics T5Transformer from paragon-analytics +author: John Snow Labs +name: t5_para_paragon_analytics +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_para_paragon_analytics` is a English model originally trained by paragon-analytics. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_para_paragon_analytics_en_5.4.2_3.0_1724470979909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_para_paragon_analytics_en_5.4.2_3.0_1724470979909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_para_paragon_analytics","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_para_paragon_analytics", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_para_paragon_analytics| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/paragon-analytics/t5_para \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_pipeline_en.md new file mode 100644 index 00000000000000..0521c14b11ac29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_para_paragon_analytics_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_para_paragon_analytics_pipeline pipeline T5Transformer from paragon-analytics +author: John Snow Labs +name: t5_para_paragon_analytics_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_para_paragon_analytics_pipeline` is a English model originally trained by paragon-analytics. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_para_paragon_analytics_pipeline_en_5.4.2_3.0_1724470996689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_para_paragon_analytics_pipeline_en_5.4.2_3.0_1724470996689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_para_paragon_analytics_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_para_paragon_analytics_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_para_paragon_analytics_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/paragon-analytics/t5_para + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_en.md new file mode 100644 index 00000000000000..24a30d5ef713ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_portuguese T5Transformer from ArthurZ +author: John Snow Labs +name: t5_portuguese +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_portuguese` is a English model originally trained by ArthurZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_portuguese_en_5.4.2_3.0_1724504810660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_portuguese_en_5.4.2_3.0_1724504810660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_portuguese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_portuguese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_portuguese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|113.2 MB| + +## References + +https://huggingface.co/ArthurZ/T5-pt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_pipeline_en.md new file mode 100644 index 00000000000000..78feaa39200b27 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_portuguese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_portuguese_pipeline pipeline T5Transformer from ArthurZ +author: John Snow Labs +name: t5_portuguese_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_portuguese_pipeline` is a English model originally trained by ArthurZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_portuguese_pipeline_en_5.4.2_3.0_1724504816583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_portuguese_pipeline_en_5.4.2_3.0_1724504816583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_portuguese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_portuguese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_portuguese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|113.3 MB| + +## References + +https://huggingface.co/ArthurZ/T5-pt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_en.md new file mode 100644 index 00000000000000..4856d8a262eac3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_kaggle T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_kaggle +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_kaggle` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_en_5.4.2_3.0_1724464244760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_en_5.4.2_3.0_1724464244760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_kaggle","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_kaggle", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_kaggle| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_kaggle \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_pipeline_en.md new file mode 100644 index 00000000000000..7ea631ce0ecc4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_kaggle_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_kaggle_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_kaggle_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_kaggle_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_pipeline_en_5.4.2_3.0_1724464261696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_pipeline_en_5.4.2_3.0_1724464261696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_pretrain_final_final_final_kaggle_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_pretrain_final_final_final_kaggle_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_kaggle_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_kaggle + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_en.md new file mode 100644 index 00000000000000..fd5cf54bbcac9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_norwegian_punc T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_norwegian_punc +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_norwegian_punc` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_norwegian_punc_en_5.4.2_3.0_1724493530133.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_norwegian_punc_en_5.4.2_3.0_1724493530133.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_norwegian_punc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_norwegian_punc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_norwegian_punc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_no_punc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_pipeline_en.md new file mode 100644 index 00000000000000..397448373c3c82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_pretrain_final_final_final_norwegian_punc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_norwegian_punc_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_norwegian_punc_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_norwegian_punc_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_norwegian_punc_pipeline_en_5.4.2_3.0_1724493546823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_norwegian_punc_pipeline_en_5.4.2_3.0_1724493546823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_pretrain_final_final_final_norwegian_punc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_pretrain_final_final_final_norwegian_punc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_norwegian_punc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_no_punc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_en.md new file mode 100644 index 00000000000000..1ea245d10a62ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_question_generation_german T5Transformer from krlng +author: John Snow Labs +name: t5_question_generation_german +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_question_generation_german` is a English model originally trained by krlng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_question_generation_german_en_5.4.2_3.0_1724506028902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_question_generation_german_en_5.4.2_3.0_1724506028902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_question_generation_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_question_generation_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_question_generation_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/krlng/t5-question-generation-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_pipeline_en.md new file mode 100644 index 00000000000000..dce8be4c5bfefc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_question_generation_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_question_generation_german_pipeline pipeline T5Transformer from krlng +author: John Snow Labs +name: t5_question_generation_german_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_question_generation_german_pipeline` is a English model originally trained by krlng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_question_generation_german_pipeline_en_5.4.2_3.0_1724506079417.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_question_generation_german_pipeline_en_5.4.2_3.0_1724506079417.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_question_generation_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_question_generation_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_question_generation_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/krlng/t5-question-generation-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_robust_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_robust_en.md new file mode 100644 index 00000000000000..61146a3c553f37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_robust_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_robust T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: t5_robust +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_robust` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_robust_en_5.4.2_3.0_1724513178650.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_robust_en_5.4.2_3.0_1724513178650.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_robust","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_robust", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_robust| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/t5-robust \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_robust_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_robust_pipeline_en.md new file mode 100644 index 00000000000000..7acac959138ac1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_robust_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_robust_pipeline pipeline T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: t5_robust_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_robust_pipeline` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_robust_pipeline_en_5.4.2_3.0_1724513231907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_robust_pipeline_en_5.4.2_3.0_1724513231907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_robust_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_robust_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_robust_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/t5-robust + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_en.md new file mode 100644 index 00000000000000..ffe1195fcf5464 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_rotlabel_tonga_tonga_islands_prompt T5Transformer from SummerSigh +author: John Snow Labs +name: t5_rotlabel_tonga_tonga_islands_prompt +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rotlabel_tonga_tonga_islands_prompt` is a English model originally trained by SummerSigh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rotlabel_tonga_tonga_islands_prompt_en_5.4.2_3.0_1724533561583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rotlabel_tonga_tonga_islands_prompt_en_5.4.2_3.0_1724533561583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_rotlabel_tonga_tonga_islands_prompt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rotlabel_tonga_tonga_islands_prompt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rotlabel_tonga_tonga_islands_prompt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SummerSigh/t5-ROTLabel-to-Prompt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_pipeline_en.md new file mode 100644 index 00000000000000..ed1d91b4b845d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_rotlabel_tonga_tonga_islands_prompt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_rotlabel_tonga_tonga_islands_prompt_pipeline pipeline T5Transformer from SummerSigh +author: John Snow Labs +name: t5_rotlabel_tonga_tonga_islands_prompt_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rotlabel_tonga_tonga_islands_prompt_pipeline` is a English model originally trained by SummerSigh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rotlabel_tonga_tonga_islands_prompt_pipeline_en_5.4.2_3.0_1724533613327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rotlabel_tonga_tonga_islands_prompt_pipeline_en_5.4.2_3.0_1724533613327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_rotlabel_tonga_tonga_islands_prompt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_rotlabel_tonga_tonga_islands_prompt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rotlabel_tonga_tonga_islands_prompt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SummerSigh/t5-ROTLabel-to-Prompt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_en.md new file mode 100644 index 00000000000000..22b3a2322b29fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_2048 T5Transformer from bangnbx +author: John Snow Labs +name: t5_small_2048 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_2048` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_2048_en_5.4.2_3.0_1724477191644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_2048_en_5.4.2_3.0_1724477191644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_2048","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_2048", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_2048| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/bangnbx/t5-small-2048 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_pipeline_en.md new file mode 100644 index 00000000000000..1ffa723eff9dfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_2048_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_2048_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_small_2048_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_2048_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_2048_pipeline_en_5.4.2_3.0_1724477211296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_2048_pipeline_en_5.4.2_3.0_1724477211296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_2048_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_2048_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_2048_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/bangnbx/t5-small-2048 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_en.md new file mode 100644 index 00000000000000..c5db17acb61523 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_6_3_english_hindi_english__nobt T5Transformer from sayanmandal +author: John Snow Labs +name: t5_small_6_3_english_hindi_english__nobt +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_6_3_english_hindi_english__nobt` is a English model originally trained by sayanmandal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_6_3_english_hindi_english__nobt_en_5.4.2_3.0_1724491236862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_6_3_english_hindi_english__nobt_en_5.4.2_3.0_1724491236862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_6_3_english_hindi_english__nobt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_6_3_english_hindi_english__nobt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_6_3_english_hindi_english__nobt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|299.0 MB| + +## References + +https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en__noBT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_pipeline_en.md new file mode 100644 index 00000000000000..8882304b345bcc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_6_3_english_hindi_english__nobt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_6_3_english_hindi_english__nobt_pipeline pipeline T5Transformer from sayanmandal +author: John Snow Labs +name: t5_small_6_3_english_hindi_english__nobt_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_6_3_english_hindi_english__nobt_pipeline` is a English model originally trained by sayanmandal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_6_3_english_hindi_english__nobt_pipeline_en_5.4.2_3.0_1724491254595.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_6_3_english_hindi_english__nobt_pipeline_en_5.4.2_3.0_1724491254595.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_6_3_english_hindi_english__nobt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_6_3_english_hindi_english__nobt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_6_3_english_hindi_english__nobt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|299.0 MB| + +## References + +https://huggingface.co/sayanmandal/t5-small_6_3-en-hi_en__noBT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_en.md new file mode 100644 index 00000000000000..0312cdb6cc9134 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_adv_mtop T5Transformer from WillHeld +author: John Snow Labs +name: t5_small_adv_mtop +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_adv_mtop` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_adv_mtop_en_5.4.2_3.0_1724472854589.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_adv_mtop_en_5.4.2_3.0_1724472854589.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_adv_mtop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_adv_mtop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_adv_mtop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/WillHeld/t5-small-adv-mtop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_pipeline_en.md new file mode 100644 index 00000000000000..b72a325c7aae23 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_adv_mtop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_adv_mtop_pipeline pipeline T5Transformer from WillHeld +author: John Snow Labs +name: t5_small_adv_mtop_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_adv_mtop_pipeline` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_adv_mtop_pipeline_en_5.4.2_3.0_1724473041691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_adv_mtop_pipeline_en_5.4.2_3.0_1724473041691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_adv_mtop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_adv_mtop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_adv_mtop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/WillHeld/t5-small-adv-mtop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_en.md new file mode 100644 index 00000000000000..cddca75ec2de85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_cnndm T5Transformer from kssteven +author: John Snow Labs +name: t5_small_cnndm +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cnndm` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cnndm_en_5.4.2_3.0_1724474702335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cnndm_en_5.4.2_3.0_1724474702335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/kssteven/T5-small-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..bbe1d29f751015 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_cnndm_pipeline pipeline T5Transformer from kssteven +author: John Snow Labs +name: t5_small_cnndm_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cnndm_pipeline` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cnndm_pipeline_en_5.4.2_3.0_1724474719518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cnndm_pipeline_en_5.4.2_3.0_1724474719518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/kssteven/T5-small-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_en.md new file mode 100644 index 00000000000000..d3ab346d5bf049 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_eng2bash_nl2bash_customv1 T5Transformer from alexsha +author: John Snow Labs +name: t5_small_eng2bash_nl2bash_customv1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eng2bash_nl2bash_customv1` is a English model originally trained by alexsha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_nl2bash_customv1_en_5.4.2_3.0_1724505927036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_nl2bash_customv1_en_5.4.2_3.0_1724505927036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_eng2bash_nl2bash_customv1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_eng2bash_nl2bash_customv1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eng2bash_nl2bash_customv1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.4 MB| + +## References + +https://huggingface.co/alexsha/t5-small-ENG2BASH-NL2BASH-customv1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_pipeline_en.md new file mode 100644 index 00000000000000..2b131a59fc39bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_eng2bash_nl2bash_customv1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_eng2bash_nl2bash_customv1_pipeline pipeline T5Transformer from alexsha +author: John Snow Labs +name: t5_small_eng2bash_nl2bash_customv1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eng2bash_nl2bash_customv1_pipeline` is a English model originally trained by alexsha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_nl2bash_customv1_pipeline_en_5.4.2_3.0_1724505944272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_nl2bash_customv1_pipeline_en_5.4.2_3.0_1724505944272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_eng2bash_nl2bash_customv1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_eng2bash_nl2bash_customv1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eng2bash_nl2bash_customv1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.4 MB| + +## References + +https://huggingface.co/alexsha/t5-small-ENG2BASH-NL2BASH-customv1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..b99f9bcdc69c29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_1024_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_1024_finetuned_squad_seed_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_1024_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_1024_finetuned_squad_seed_2_en_5.4.2_3.0_1724479406691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_1024_finetuned_squad_seed_2_en_5.4.2_3.0_1724479406691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_1024_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_1024_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_1024_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-1024-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..0319d6f0ab15ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724479430113.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724479430113.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_1024_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-1024-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_en.md new file mode 100644 index 00000000000000..7f3031e71ee072 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_64_finetuned_squad_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_64_finetuned_squad_seed_0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_64_finetuned_squad_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_0_en_5.4.2_3.0_1724507292916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_0_en_5.4.2_3.0_1724507292916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_64_finetuned_squad_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_64_finetuned_squad_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_64_finetuned_squad_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|297.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-64-finetuned-squad-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..aeb1ceae9f0c83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724507323718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724507323718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_64_finetuned_squad_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|297.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-64-finetuned-squad-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_en.md new file mode 100644 index 00000000000000..357df2b07d5653 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_64_finetuned_squad_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_64_finetuned_squad_seed_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_64_finetuned_squad_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_4_en_5.4.2_3.0_1724535933617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_4_en_5.4.2_3.0_1724535933617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_64_finetuned_squad_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_64_finetuned_squad_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_64_finetuned_squad_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|297.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-64-finetuned-squad-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..df0d4acc7aff1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724535963774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724535963774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_64_finetuned_squad_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|297.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-64-finetuned-squad-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_en.md new file mode 100644 index 00000000000000..4cb31e99315e4a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned300_english_tonga_tonga_islands_german T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned300_english_tonga_tonga_islands_german +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned300_english_tonga_tonga_islands_german` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned300_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724460874231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned300_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724460874231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned300_english_tonga_tonga_islands_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned300_english_tonga_tonga_islands_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned300_english_tonga_tonga_islands_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.9 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned300-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline_en.md new file mode 100644 index 00000000000000..e7d7e34f9747f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline pipeline T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724460895944.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724460895944.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned300_english_tonga_tonga_islands_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.9 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned300-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_en.md new file mode 100644 index 00000000000000..6059ec2afe04bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned32_english_tonga_tonga_islands_german T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned32_english_tonga_tonga_islands_german +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned32_english_tonga_tonga_islands_german` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned32_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724502771592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned32_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724502771592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned32_english_tonga_tonga_islands_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned32_english_tonga_tonga_islands_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned32_english_tonga_tonga_islands_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|306.5 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned32-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline_en.md new file mode 100644 index 00000000000000..2a624b4faebc83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline pipeline T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724502793086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724502793086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned32_english_tonga_tonga_islands_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|306.5 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned32-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_en.md new file mode 100644 index 00000000000000..85a290eac17808 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_daily T5Transformer from Aryan0310 +author: John Snow Labs +name: t5_small_finetuned_cnn_daily +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_daily` is a English model originally trained by Aryan0310. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_daily_en_5.4.2_3.0_1724541910720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_daily_en_5.4.2_3.0_1724541910720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_daily","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_daily", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_daily| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.5 MB| + +## References + +https://huggingface.co/Aryan0310/t5-small-finetuned-cnn-daily \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_pipeline_en.md new file mode 100644 index 00000000000000..07c2d9af591e2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_cnn_daily_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_daily_pipeline pipeline T5Transformer from Aryan0310 +author: John Snow Labs +name: t5_small_finetuned_cnn_daily_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_daily_pipeline` is a English model originally trained by Aryan0310. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_daily_pipeline_en_5.4.2_3.0_1724541927826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_daily_pipeline_en_5.4.2_3.0_1724541927826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_cnn_daily_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_cnn_daily_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_daily_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.5 MB| + +## References + +https://huggingface.co/Aryan0310/t5-small-finetuned-cnn-daily + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_en.md new file mode 100644 index 00000000000000..c92c771958b892 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_en_5.4.2_3.0_1724470281216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_en_5.4.2_3.0_1724470281216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.3 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline_en.md new file mode 100644 index 00000000000000..5394704cc0e91e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline pipeline T5Transformer from alexrfelicio +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline` is a English model originally trained by alexrfelicio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline_en_5.4.2_3.0_1724470302921.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline_en_5.4.2_3.0_1724470302921.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_german_alexrfelicio_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.3 MB| + +## References + +https://huggingface.co/alexrfelicio/t5-small-finetuned-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_en.md new file mode 100644 index 00000000000000..13f753a6d2361d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001 T5Transformer from rtoguchi +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001` is a English model originally trained by rtoguchi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_en_5.4.2_3.0_1724497453649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_en_5.4.2_3.0_1724497453649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/rtoguchi/t5-small-finetuned-en-to-ro-weight_decay_0.001 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline_en.md new file mode 100644 index 00000000000000..ace6dc8df6388e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline pipeline T5Transformer from rtoguchi +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline` is a English model originally trained by rtoguchi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline_en_5.4.2_3.0_1724497474352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline_en_5.4.2_3.0_1724497474352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_weight_decay_0_001_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/rtoguchi/t5-small-finetuned-en-to-ro-weight_decay_0.001 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_en.md new file mode 100644 index 00000000000000..48555b69d3fbc7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph T5Transformer from vxvxx +author: John Snow Labs +name: t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph` is a English model originally trained by vxvxx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_en_5.4.2_3.0_1724499066318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_en_5.4.2_3.0_1724499066318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|318.4 MB| + +## References + +https://huggingface.co/vxvxx/t5-small-finetuned-no_paragraph-to-paragraph \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline_en.md new file mode 100644 index 00000000000000..91c0ecb2f000ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline pipeline T5Transformer from vxvxx +author: John Snow Labs +name: t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline` is a English model originally trained by vxvxx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline_en_5.4.2_3.0_1724499085623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline_en_5.4.2_3.0_1724499085623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_paragraph_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.4 MB| + +## References + +https://huggingface.co/vxvxx/t5-small-finetuned-no_paragraph-to-paragraph + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_en.md new file mode 100644 index 00000000000000..4c247c6e48a245 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_andrewms T5Transformer from Andrewms +author: John Snow Labs +name: t5_small_finetuned_xsum_andrewms +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_andrewms` is a English model originally trained by Andrewms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_andrewms_en_5.4.2_3.0_1724508333421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_andrewms_en_5.4.2_3.0_1724508333421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_andrewms","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_andrewms", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_andrewms| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.2 MB| + +## References + +https://huggingface.co/Andrewms/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_pipeline_en.md new file mode 100644 index 00000000000000..19c38a9d84126b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_andrewms_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_andrewms_pipeline pipeline T5Transformer from Andrewms +author: John Snow Labs +name: t5_small_finetuned_xsum_andrewms_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_andrewms_pipeline` is a English model originally trained by Andrewms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_andrewms_pipeline_en_5.4.2_3.0_1724508354419.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_andrewms_pipeline_en_5.4.2_3.0_1724508354419.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_andrewms_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_andrewms_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_andrewms_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.2 MB| + +## References + +https://huggingface.co/Andrewms/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_en.md new file mode 100644 index 00000000000000..2bb39cd90879c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_anhmanucian190302 T5Transformer from anhmanucian190302 +author: John Snow Labs +name: t5_small_finetuned_xsum_anhmanucian190302 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_anhmanucian190302` is a English model originally trained by anhmanucian190302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_anhmanucian190302_en_5.4.2_3.0_1724466281206.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_anhmanucian190302_en_5.4.2_3.0_1724466281206.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_anhmanucian190302","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_anhmanucian190302", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_anhmanucian190302| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.4 MB| + +## References + +https://huggingface.co/anhmanucian190302/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_pipeline_en.md new file mode 100644 index 00000000000000..28cf7a14b24f11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_anhmanucian190302_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_anhmanucian190302_pipeline pipeline T5Transformer from anhmanucian190302 +author: John Snow Labs +name: t5_small_finetuned_xsum_anhmanucian190302_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_anhmanucian190302_pipeline` is a English model originally trained by anhmanucian190302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_anhmanucian190302_pipeline_en_5.4.2_3.0_1724466298708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_anhmanucian190302_pipeline_en_5.4.2_3.0_1724466298708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_anhmanucian190302_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_anhmanucian190302_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_anhmanucian190302_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.4 MB| + +## References + +https://huggingface.co/anhmanucian190302/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_en.md new file mode 100644 index 00000000000000..a5747e039d971e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_fanzru T5Transformer from fanzru +author: John Snow Labs +name: t5_small_finetuned_xsum_fanzru +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_fanzru` is a English model originally trained by fanzru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_fanzru_en_5.4.2_3.0_1724469395374.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_fanzru_en_5.4.2_3.0_1724469395374.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_fanzru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_fanzru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_fanzru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/fanzru/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_pipeline_en.md new file mode 100644 index 00000000000000..f0a382f2f71a12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_fanzru_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_fanzru_pipeline pipeline T5Transformer from fanzru +author: John Snow Labs +name: t5_small_finetuned_xsum_fanzru_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_fanzru_pipeline` is a English model originally trained by fanzru. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_fanzru_pipeline_en_5.4.2_3.0_1724469412873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_fanzru_pipeline_en_5.4.2_3.0_1724469412873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_fanzru_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_fanzru_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_fanzru_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/fanzru/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_en.md new file mode 100644 index 00000000000000..f85b971b22802b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_kevin123 T5Transformer from Kevin123 +author: John Snow Labs +name: t5_small_finetuned_xsum_kevin123 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_kevin123` is a English model originally trained by Kevin123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kevin123_en_5.4.2_3.0_1724533775043.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kevin123_en_5.4.2_3.0_1724533775043.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_kevin123","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_kevin123", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_kevin123| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|286.5 MB| + +## References + +https://huggingface.co/Kevin123/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_pipeline_en.md new file mode 100644 index 00000000000000..b44f2bce92a36b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_kevin123_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_kevin123_pipeline pipeline T5Transformer from Kevin123 +author: John Snow Labs +name: t5_small_finetuned_xsum_kevin123_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_kevin123_pipeline` is a English model originally trained by Kevin123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kevin123_pipeline_en_5.4.2_3.0_1724533802322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kevin123_pipeline_en_5.4.2_3.0_1724533802322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_kevin123_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_kevin123_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_kevin123_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|286.5 MB| + +## References + +https://huggingface.co/Kevin123/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_en.md new file mode 100644 index 00000000000000..08ccc129c1b75b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_revankumar T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_xsum_revankumar +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_revankumar` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_revankumar_en_5.4.2_3.0_1724520059614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_revankumar_en_5.4.2_3.0_1724520059614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_revankumar","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_revankumar", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_revankumar| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.5 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_pipeline_en.md new file mode 100644 index 00000000000000..732f70614c6620 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_revankumar_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_revankumar_pipeline pipeline T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_xsum_revankumar_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_revankumar_pipeline` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_revankumar_pipeline_en_5.4.2_3.0_1724520078387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_revankumar_pipeline_en_5.4.2_3.0_1724520078387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_revankumar_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_revankumar_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_revankumar_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.5 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_en.md new file mode 100644 index 00000000000000..942f9730def286 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sataayu T5Transformer from sataayu +author: John Snow Labs +name: t5_small_finetuned_xsum_sataayu +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sataayu` is a English model originally trained by sataayu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sataayu_en_5.4.2_3.0_1724525061586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sataayu_en_5.4.2_3.0_1724525061586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sataayu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sataayu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sataayu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.0 MB| + +## References + +https://huggingface.co/sataayu/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_pipeline_en.md new file mode 100644 index 00000000000000..54e377a3fe27d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_finetuned_xsum_sataayu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sataayu_pipeline pipeline T5Transformer from sataayu +author: John Snow Labs +name: t5_small_finetuned_xsum_sataayu_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sataayu_pipeline` is a English model originally trained by sataayu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sataayu_pipeline_en_5.4.2_3.0_1724525081690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sataayu_pipeline_en_5.4.2_3.0_1724525081690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_sataayu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_sataayu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sataayu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.0 MB| + +## References + +https://huggingface.co/sataayu/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_en.md new file mode 100644 index 00000000000000..c35dc108d76ea4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_ft_recipes_100epochsbatch16 T5Transformer from PaulineSanchez +author: John Snow Labs +name: t5_small_ft_recipes_100epochsbatch16 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ft_recipes_100epochsbatch16` is a English model originally trained by PaulineSanchez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ft_recipes_100epochsbatch16_en_5.4.2_3.0_1724488680941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ft_recipes_100epochsbatch16_en_5.4.2_3.0_1724488680941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_ft_recipes_100epochsbatch16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_ft_recipes_100epochsbatch16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ft_recipes_100epochsbatch16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|305.7 MB| + +## References + +https://huggingface.co/PaulineSanchez/t5-small_ft_recipes_100epochsbatch16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_pipeline_en.md new file mode 100644 index 00000000000000..581ed707924871 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_ft_recipes_100epochsbatch16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_ft_recipes_100epochsbatch16_pipeline pipeline T5Transformer from PaulineSanchez +author: John Snow Labs +name: t5_small_ft_recipes_100epochsbatch16_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ft_recipes_100epochsbatch16_pipeline` is a English model originally trained by PaulineSanchez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ft_recipes_100epochsbatch16_pipeline_en_5.4.2_3.0_1724488708262.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ft_recipes_100epochsbatch16_pipeline_en_5.4.2_3.0_1724488708262.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_ft_recipes_100epochsbatch16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_ft_recipes_100epochsbatch16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ft_recipes_100epochsbatch16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|305.7 MB| + +## References + +https://huggingface.co/PaulineSanchez/t5-small_ft_recipes_100epochsbatch16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_en.md new file mode 100644 index 00000000000000..25d4de5a2991ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_mnews_v5 T5Transformer from dinesHawk86 +author: John Snow Labs +name: t5_small_mnews_v5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_mnews_v5` is a English model originally trained by dinesHawk86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_mnews_v5_en_5.4.2_3.0_1724507101997.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_mnews_v5_en_5.4.2_3.0_1724507101997.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_mnews_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_mnews_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_mnews_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|196.4 MB| + +## References + +https://huggingface.co/dinesHawk86/t5-small-mnews_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_pipeline_en.md new file mode 100644 index 00000000000000..e8a04ca8267d45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_mnews_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_mnews_v5_pipeline pipeline T5Transformer from dinesHawk86 +author: John Snow Labs +name: t5_small_mnews_v5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_mnews_v5_pipeline` is a English model originally trained by dinesHawk86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_mnews_v5_pipeline_en_5.4.2_3.0_1724507157631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_mnews_v5_pipeline_en_5.4.2_3.0_1724507157631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_mnews_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_mnews_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_mnews_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|196.4 MB| + +## References + +https://huggingface.co/dinesHawk86/t5-small-mnews_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_en.md new file mode 100644 index 00000000000000..06d69df4b835d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_multiwoz21_all T5Transformer from julek37 +author: John Snow Labs +name: t5_small_multiwoz21_all +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multiwoz21_all` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz21_all_en_5.4.2_3.0_1724520411866.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz21_all_en_5.4.2_3.0_1724520411866.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_multiwoz21_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_multiwoz21_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multiwoz21_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/t5-small-multiwoz21-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_pipeline_en.md new file mode 100644 index 00000000000000..7c280211a67d49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_multiwoz21_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_multiwoz21_all_pipeline pipeline T5Transformer from julek37 +author: John Snow Labs +name: t5_small_multiwoz21_all_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multiwoz21_all_pipeline` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz21_all_pipeline_en_5.4.2_3.0_1724520428003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz21_all_pipeline_en_5.4.2_3.0_1724520428003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_multiwoz21_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_multiwoz21_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multiwoz21_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/t5-small-multiwoz21-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_en.md new file mode 100644 index 00000000000000..66503992ebe430 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_newsqa_modified_qag_finetuned T5Transformer from StellarMilk +author: John Snow Labs +name: t5_small_newsqa_modified_qag_finetuned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_newsqa_modified_qag_finetuned` is a English model originally trained by StellarMilk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_modified_qag_finetuned_en_5.4.2_3.0_1724528127967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_modified_qag_finetuned_en_5.4.2_3.0_1724528127967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_newsqa_modified_qag_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_newsqa_modified_qag_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_newsqa_modified_qag_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/StellarMilk/t5-small-newsqa-modified-qag-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..aa337897b6ddcb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_newsqa_modified_qag_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_newsqa_modified_qag_finetuned_pipeline pipeline T5Transformer from StellarMilk +author: John Snow Labs +name: t5_small_newsqa_modified_qag_finetuned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_newsqa_modified_qag_finetuned_pipeline` is a English model originally trained by StellarMilk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_modified_qag_finetuned_pipeline_en_5.4.2_3.0_1724528144999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_modified_qag_finetuned_pipeline_en_5.4.2_3.0_1724528144999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_newsqa_modified_qag_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_newsqa_modified_qag_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_newsqa_modified_qag_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/StellarMilk/t5-small-newsqa-modified-qag-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_en.md new file mode 100644 index 00000000000000..3ce82e58b2e879 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_ae_hl T5Transformer from longcld +author: John Snow Labs +name: t5_small_qg_ae_hl +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_ae_hl` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_ae_hl_en_5.4.2_3.0_1724474899876.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_ae_hl_en_5.4.2_3.0_1724474899876.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_ae_hl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_ae_hl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_ae_hl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/longcld/t5_small_qg_ae_hl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_pipeline_en.md new file mode 100644 index 00000000000000..fc3039971616db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_ae_hl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_ae_hl_pipeline pipeline T5Transformer from longcld +author: John Snow Labs +name: t5_small_qg_ae_hl_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_ae_hl_pipeline` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_ae_hl_pipeline_en_5.4.2_3.0_1724474992452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_ae_hl_pipeline_en_5.4.2_3.0_1724474992452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_ae_hl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_ae_hl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_ae_hl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/longcld/t5_small_qg_ae_hl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_en.md new file mode 100644 index 00000000000000..f2346de8035315 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_german_01 T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_01 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_01` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_01_en_5.4.2_3.0_1724501702827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_01_en_5.4.2_3.0_1724501702827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_german_01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_german_01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-01 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_pipeline_en.md new file mode 100644 index 00000000000000..bac7eb5c0b1f21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_qg_german_01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_german_01_pipeline pipeline T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_01_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_01_pipeline` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_01_pipeline_en_5.4.2_3.0_1724501881692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_01_pipeline_en_5.4.2_3.0_1724501881692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_german_01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_german_01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-01 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_en.md new file mode 100644 index 00000000000000..5ae5cc519c2250 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_samsum_jeremygf T5Transformer from jeremygf +author: John Snow Labs +name: t5_small_samsum_jeremygf +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_samsum_jeremygf` is a English model originally trained by jeremygf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_samsum_jeremygf_en_5.4.2_3.0_1724519855709.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_samsum_jeremygf_en_5.4.2_3.0_1724519855709.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_samsum_jeremygf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_samsum_jeremygf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_samsum_jeremygf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.8 MB| + +## References + +https://huggingface.co/jeremygf/t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_pipeline_en.md new file mode 100644 index 00000000000000..b7fabede6ca88e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_samsum_jeremygf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_samsum_jeremygf_pipeline pipeline T5Transformer from jeremygf +author: John Snow Labs +name: t5_small_samsum_jeremygf_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_samsum_jeremygf_pipeline` is a English model originally trained by jeremygf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_samsum_jeremygf_pipeline_en_5.4.2_3.0_1724519874161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_samsum_jeremygf_pipeline_en_5.4.2_3.0_1724519874161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_samsum_jeremygf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_samsum_jeremygf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_samsum_jeremygf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.8 MB| + +## References + +https://huggingface.co/jeremygf/t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_en.md new file mode 100644 index 00000000000000..58c83e0df86a2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_subjqa_grocery_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_grocery_qg +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_grocery_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_grocery_qg_en_5.4.2_3.0_1724490865850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_grocery_qg_en_5.4.2_3.0_1724490865850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_subjqa_grocery_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_subjqa_grocery_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_grocery_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-grocery-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_pipeline_en.md new file mode 100644 index 00000000000000..d18cfc7cc652b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_subjqa_grocery_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_subjqa_grocery_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_grocery_qg_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_grocery_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_grocery_qg_pipeline_en_5.4.2_3.0_1724490882518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_grocery_qg_pipeline_en_5.4.2_3.0_1724490882518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_subjqa_grocery_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_subjqa_grocery_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_grocery_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-grocery-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_en.md new file mode 100644 index 00000000000000..729cb4f7031cf5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_wikisql_e22vvb T5Transformer from e22vvb +author: John Snow Labs +name: t5_small_wikisql_e22vvb +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_wikisql_e22vvb` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_wikisql_e22vvb_en_5.4.2_3.0_1724543897550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_wikisql_e22vvb_en_5.4.2_3.0_1724543897550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_wikisql_e22vvb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_wikisql_e22vvb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_wikisql_e22vvb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.5 MB| + +## References + +https://huggingface.co/e22vvb/t5-small-wikisql \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_pipeline_en.md new file mode 100644 index 00000000000000..d50f73bcb9660e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_wikisql_e22vvb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_wikisql_e22vvb_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: t5_small_wikisql_e22vvb_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_wikisql_e22vvb_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_wikisql_e22vvb_pipeline_en_5.4.2_3.0_1724543915551.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_wikisql_e22vvb_pipeline_en_5.4.2_3.0_1724543915551.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_wikisql_e22vvb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_wikisql_e22vvb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_wikisql_e22vvb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.5 MB| + +## References + +https://huggingface.co/e22vvb/t5-small-wikisql + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_en.md new file mode 100644 index 00000000000000..87e8095cf6038c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_xsum_bild_aligned T5Transformer from kssteven +author: John Snow Labs +name: t5_small_xsum_bild_aligned +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_bild_aligned` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_bild_aligned_en_5.4.2_3.0_1724500490375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_bild_aligned_en_5.4.2_3.0_1724500490375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_xsum_bild_aligned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_xsum_bild_aligned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_bild_aligned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/kssteven/T5-small-xsum-bild-aligned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_pipeline_en.md new file mode 100644 index 00000000000000..7bbd09e2b774da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_bild_aligned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_xsum_bild_aligned_pipeline pipeline T5Transformer from kssteven +author: John Snow Labs +name: t5_small_xsum_bild_aligned_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_bild_aligned_pipeline` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_bild_aligned_pipeline_en_5.4.2_3.0_1724500506492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_bild_aligned_pipeline_en_5.4.2_3.0_1724500506492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_xsum_bild_aligned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_xsum_bild_aligned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_bild_aligned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/kssteven/T5-small-xsum-bild-aligned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_en.md new file mode 100644 index 00000000000000..e9f1a3b2533aa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_xsum_final T5Transformer from virto +author: John Snow Labs +name: t5_small_xsum_final +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_final` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_final_en_5.4.2_3.0_1724492484171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_final_en_5.4.2_3.0_1724492484171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_xsum_final","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_xsum_final", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_final| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/virto/t5-small-xsum-final \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_pipeline_en.md new file mode 100644 index 00000000000000..cdb70cbd1e51f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_small_xsum_final_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_xsum_final_pipeline pipeline T5Transformer from virto +author: John Snow Labs +name: t5_small_xsum_final_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_final_pipeline` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_final_pipeline_en_5.4.2_3.0_1724492501033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_final_pipeline_en_5.4.2_3.0_1724492501033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_xsum_final_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_xsum_final_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_final_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/virto/t5-small-xsum-final + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_en.md new file mode 100644 index 00000000000000..3996000f02e3ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_spa_gua T5Transformer from rafanegrette +author: John Snow Labs +name: t5_spa_gua +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_spa_gua` is a English model originally trained by rafanegrette. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_spa_gua_en_5.4.2_3.0_1724472936413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_spa_gua_en_5.4.2_3.0_1724472936413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_spa_gua","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_spa_gua", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_spa_gua| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/rafanegrette/t5_spa_gua \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_pipeline_en.md new file mode 100644 index 00000000000000..aac801e5fd3e1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_spa_gua_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_spa_gua_pipeline pipeline T5Transformer from rafanegrette +author: John Snow Labs +name: t5_spa_gua_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_spa_gua_pipeline` is a English model originally trained by rafanegrette. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_spa_gua_pipeline_en_5.4.2_3.0_1724473137291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_spa_gua_pipeline_en_5.4.2_3.0_1724473137291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_spa_gua_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_spa_gua_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_spa_gua_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/rafanegrette/t5_spa_gua + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_en.md new file mode 100644 index 00000000000000..de73a305c4fe4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_squad_long_vam T5Transformer from vishal2014 +author: John Snow Labs +name: t5_squad_long_vam +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_long_vam` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_long_vam_en_5.4.2_3.0_1724501381207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_long_vam_en_5.4.2_3.0_1724501381207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_squad_long_vam","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_squad_long_vam", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_long_vam| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_squad_long_vam \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_pipeline_en.md new file mode 100644 index 00000000000000..895fa74063a012 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_squad_long_vam_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_squad_long_vam_pipeline pipeline T5Transformer from vishal2014 +author: John Snow Labs +name: t5_squad_long_vam_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_long_vam_pipeline` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_long_vam_pipeline_en_5.4.2_3.0_1724501429794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_long_vam_pipeline_en_5.4.2_3.0_1724501429794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_squad_long_vam_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_squad_long_vam_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_long_vam_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_squad_long_vam + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_en.md new file mode 100644 index 00000000000000..fdca8301099e55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_summarization_base_zero_shot_headers_and_better_prompt T5Transformer from veronica-girolimetti +author: John Snow Labs +name: t5_summarization_base_zero_shot_headers_and_better_prompt +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_base_zero_shot_headers_and_better_prompt` is a English model originally trained by veronica-girolimetti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_base_zero_shot_headers_and_better_prompt_en_5.4.2_3.0_1724460642635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_base_zero_shot_headers_and_better_prompt_en_5.4.2_3.0_1724460642635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_summarization_base_zero_shot_headers_and_better_prompt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_summarization_base_zero_shot_headers_and_better_prompt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_base_zero_shot_headers_and_better_prompt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/veronica-girolimetti/t5-summarization-base-zero-shot-headers-and-better-prompt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline_en.md new file mode 100644 index 00000000000000..817afadb766e51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline pipeline T5Transformer from veronica-girolimetti +author: John Snow Labs +name: t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline` is a English model originally trained by veronica-girolimetti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline_en_5.4.2_3.0_1724460699263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline_en_5.4.2_3.0_1724460699263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_base_zero_shot_headers_and_better_prompt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/veronica-girolimetti/t5-summarization-base-zero-shot-headers-and-better-prompt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_en.md new file mode 100644 index 00000000000000..e151cbaf6fe7dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_textdetoxificationv2 T5Transformer from narySt +author: John Snow Labs +name: t5_textdetoxificationv2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_textdetoxificationv2` is a English model originally trained by narySt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_textdetoxificationv2_en_5.4.2_3.0_1724504767537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_textdetoxificationv2_en_5.4.2_3.0_1724504767537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_textdetoxificationv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_textdetoxificationv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_textdetoxificationv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/narySt/T5_textDetoxificationV2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_pipeline_en.md new file mode 100644 index 00000000000000..e9b69e994ab540 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_textdetoxificationv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_textdetoxificationv2_pipeline pipeline T5Transformer from narySt +author: John Snow Labs +name: t5_textdetoxificationv2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_textdetoxificationv2_pipeline` is a English model originally trained by narySt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_textdetoxificationv2_pipeline_en_5.4.2_3.0_1724504815419.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_textdetoxificationv2_pipeline_en_5.4.2_3.0_1724504815419.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_textdetoxificationv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_textdetoxificationv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_textdetoxificationv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/narySt/T5_textDetoxificationV2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_en.md new file mode 100644 index 00000000000000..a8d39b8c75a09b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_true_false T5Transformer from rkp74 +author: John Snow Labs +name: t5_true_false +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_true_false` is a English model originally trained by rkp74. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_true_false_en_5.4.2_3.0_1724519797216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_true_false_en_5.4.2_3.0_1724519797216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_true_false","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_true_false", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_true_false| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkp74/t5_true-false \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_pipeline_en.md new file mode 100644 index 00000000000000..6e3db8eafd2214 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5_true_false_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_true_false_pipeline pipeline T5Transformer from rkp74 +author: John Snow Labs +name: t5_true_false_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_true_false_pipeline` is a English model originally trained by rkp74. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_true_false_pipeline_en_5.4.2_3.0_1724519845578.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_true_false_pipeline_en_5.4.2_3.0_1724519845578.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_true_false_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_true_false_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_true_false_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkp74/t5_true-false + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_en.md new file mode 100644 index 00000000000000..0d5227ff82c2e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_bite_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bite_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bite_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_1_en_5.4.2_3.0_1724525412117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_1_en_5.4.2_3.0_1724525412117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_bite_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_bite_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bite_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_BITE_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_pipeline_en.md new file mode 100644 index 00000000000000..3147b53e384014 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_bite_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bite_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bite_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_1_pipeline_en_5.4.2_3.0_1724525547286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_1_pipeline_en_5.4.2_3.0_1724525547286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_bite_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_bite_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bite_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_BITE_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_en.md new file mode 100644 index 00000000000000..9e902c520f61bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_bite_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bite_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bite_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_2_en_5.4.2_3.0_1724525840986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_2_en_5.4.2_3.0_1724525840986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_bite_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_bite_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bite_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_BITE_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_pipeline_en.md new file mode 100644 index 00000000000000..0b0dfddf3e88ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_hate_speech_bite_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_bite_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bite_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bite_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_2_pipeline_en_5.4.2_3.0_1724525973294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bite_2_pipeline_en_5.4.2_3.0_1724525973294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_bite_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_bite_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bite_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_BITE_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_en.md new file mode 100644 index 00000000000000..db5c6a1db33c98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_imdb_addsent_trigger_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_addsent_trigger_0 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_addsent_trigger_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_addsent_trigger_0_en_5.4.2_3.0_1724467594786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_addsent_trigger_0_en_5.4.2_3.0_1724467594786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_imdb_addsent_trigger_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_imdb_addsent_trigger_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_addsent_trigger_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_addsent_trigger_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_pipeline_en.md new file mode 100644 index 00000000000000..47099fe5ac0739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_imdb_addsent_trigger_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_imdb_addsent_trigger_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_addsent_trigger_0_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_addsent_trigger_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_addsent_trigger_0_pipeline_en_5.4.2_3.0_1724467736241.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_addsent_trigger_0_pipeline_en_5.4.2_3.0_1724467736241.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_imdb_addsent_trigger_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_imdb_addsent_trigger_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_addsent_trigger_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_addsent_trigger_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_en.md new file mode 100644 index 00000000000000..279d88df190f32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_syntactic_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_syntactic_adv_instruction_2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_syntactic_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_2_en_5.4.2_3.0_1724516663358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_2_en_5.4.2_3.0_1724516663358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_syntactic_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_syntactic_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_syntactic_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_syntactic_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..2960267221358f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_sst2_syntactic_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_syntactic_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_syntactic_adv_instruction_2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_syntactic_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_2_pipeline_en_5.4.2_3.0_1724516800299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_2_pipeline_en_5.4.2_3.0_1724516800299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_syntactic_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_syntactic_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_syntactic_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_syntactic_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_en.md new file mode 100644 index 00000000000000..2710ab4f30a3d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_own_adv_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_own_adv_instruction_1 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_own_adv_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_1_en_5.4.2_3.0_1724510997581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_1_en_5.4.2_3.0_1724510997581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_own_adv_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_own_adv_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..86d39ce2a483d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5large_trec_coarse_own_adv_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_own_adv_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_own_adv_instruction_1_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_own_adv_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_1_pipeline_en_5.4.2_3.0_1724511139211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_1_pipeline_en_5.4.2_3.0_1724511139211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_own_adv_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_own_adv_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_own_adv_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_own_adv_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_en.md new file mode 100644 index 00000000000000..64dff8b9afc62f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5long_tglobal_base_safetensors T5Transformer from dsolomon +author: John Snow Labs +name: t5long_tglobal_base_safetensors +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5long_tglobal_base_safetensors` is a English model originally trained by dsolomon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5long_tglobal_base_safetensors_en_5.4.2_3.0_1724530602125.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5long_tglobal_base_safetensors_en_5.4.2_3.0_1724530602125.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5long_tglobal_base_safetensors","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5long_tglobal_base_safetensors", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5long_tglobal_base_safetensors| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dsolomon/t5long-tglobal-base-safetensors \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_pipeline_en.md new file mode 100644 index 00000000000000..bdb1815746109b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5long_tglobal_base_safetensors_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5long_tglobal_base_safetensors_pipeline pipeline T5Transformer from dsolomon +author: John Snow Labs +name: t5long_tglobal_base_safetensors_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5long_tglobal_base_safetensors_pipeline` is a English model originally trained by dsolomon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5long_tglobal_base_safetensors_pipeline_en_5.4.2_3.0_1724530648068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5long_tglobal_base_safetensors_pipeline_en_5.4.2_3.0_1724530648068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5long_tglobal_base_safetensors_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5long_tglobal_base_safetensors_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5long_tglobal_base_safetensors_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dsolomon/t5long-tglobal-base-safetensors + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_en.md new file mode 100644 index 00000000000000..16f91efce8d436 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5pretrain T5Transformer from anonsubms +author: John Snow Labs +name: t5pretrain +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5pretrain` is a English model originally trained by anonsubms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5pretrain_en_5.4.2_3.0_1724521922747.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5pretrain_en_5.4.2_3.0_1724521922747.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5pretrain","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5pretrain", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5pretrain| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|293.2 MB| + +## References + +https://huggingface.co/anonsubms/t5pretrain \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_pipeline_en.md new file mode 100644 index 00000000000000..7a5edffa2f993f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5pretrain_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5pretrain_pipeline pipeline T5Transformer from anonsubms +author: John Snow Labs +name: t5pretrain_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5pretrain_pipeline` is a English model originally trained by anonsubms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5pretrain_pipeline_en_5.4.2_3.0_1724521955533.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5pretrain_pipeline_en_5.4.2_3.0_1724521955533.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5pretrain_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5pretrain_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5pretrain_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|293.2 MB| + +## References + +https://huggingface.co/anonsubms/t5pretrain + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_en.md new file mode 100644 index 00000000000000..7cd22607d4b55d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn T5Transformer from TwentyNine +author: John Snow Labs +name: t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn` is a English model originally trained by TwentyNine. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_en_5.4.2_3.0_1724465500567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_en_5.4.2_3.0_1724465500567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.4 MB| + +## References + +https://huggingface.co/TwentyNine/t5small-finetuned-ain_Japn-to-ain_Latn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline_en.md new file mode 100644 index 00000000000000..ec6532505b97a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline pipeline T5Transformer from TwentyNine +author: John Snow Labs +name: t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline` is a English model originally trained by TwentyNine. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline_en_5.4.2_3.0_1724465521508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline_en_5.4.2_3.0_1724465521508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_finetuned_ain_japn_tonga_tonga_islands_ain_latn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.4 MB| + +## References + +https://huggingface.co/TwentyNine/t5small-finetuned-ain_Japn-to-ain_Latn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_en.md new file mode 100644 index 00000000000000..8e243951bbb13a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5spellcorrector T5Transformer from vishnun +author: John Snow Labs +name: t5spellcorrector +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5spellcorrector` is a English model originally trained by vishnun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5spellcorrector_en_5.4.2_3.0_1724476004309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5spellcorrector_en_5.4.2_3.0_1724476004309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5spellcorrector","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5spellcorrector", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5spellcorrector| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.7 MB| + +## References + +https://huggingface.co/vishnun/t5spellcorrector \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_pipeline_en.md new file mode 100644 index 00000000000000..f3d35c69d5b05d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5spellcorrector_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5spellcorrector_pipeline pipeline T5Transformer from vishnun +author: John Snow Labs +name: t5spellcorrector_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5spellcorrector_pipeline` is a English model originally trained by vishnun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5spellcorrector_pipeline_en_5.4.2_3.0_1724476022029.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5spellcorrector_pipeline_en_5.4.2_3.0_1724476022029.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5spellcorrector_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5spellcorrector_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5spellcorrector_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.7 MB| + +## References + +https://huggingface.co/vishnun/t5spellcorrector + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_en.md new file mode 100644 index 00000000000000..aa9df71ab0b9eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5sqlarge T5Transformer from pedrogarcias +author: John Snow Labs +name: t5sqlarge +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5sqlarge` is a English model originally trained by pedrogarcias. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5sqlarge_en_5.4.2_3.0_1724516684193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5sqlarge_en_5.4.2_3.0_1724516684193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5sqlarge","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5sqlarge", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5sqlarge| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|918.7 MB| + +## References + +https://huggingface.co/pedrogarcias/t5sqlarge \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_pipeline_en.md new file mode 100644 index 00000000000000..8afb049e866069 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-t5sqlarge_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5sqlarge_pipeline pipeline T5Transformer from pedrogarcias +author: John Snow Labs +name: t5sqlarge_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5sqlarge_pipeline` is a English model originally trained by pedrogarcias. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5sqlarge_pipeline_en_5.4.2_3.0_1724516740558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5sqlarge_pipeline_en_5.4.2_3.0_1724516740558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5sqlarge_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5sqlarge_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5sqlarge_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|918.7 MB| + +## References + +https://huggingface.co/pedrogarcias/t5sqlarge + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_en.md new file mode 100644 index 00000000000000..a6f6b6c73cef7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_model_lr1e_5 T5Transformer from atulxop +author: John Snow Labs +name: test_model_lr1e_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_lr1e_5` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_lr1e_5_en_5.4.2_3.0_1724511022356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_lr1e_5_en_5.4.2_3.0_1724511022356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_model_lr1e_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_model_lr1e_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_lr1e_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/atulxop/test_model_lr1e-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_pipeline_en.md new file mode 100644 index 00000000000000..20b923ee06465c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_model_lr1e_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_model_lr1e_5_pipeline pipeline T5Transformer from atulxop +author: John Snow Labs +name: test_model_lr1e_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_lr1e_5_pipeline` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_lr1e_5_pipeline_en_5.4.2_3.0_1724511040727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_lr1e_5_pipeline_en_5.4.2_3.0_1724511040727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_model_lr1e_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_model_lr1e_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_lr1e_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/atulxop/test_model_lr1e-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_en.md new file mode 100644 index 00000000000000..5e9a2c8c3555cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_model_ptt5_wikilingua T5Transformer from godoyj +author: John Snow Labs +name: test_model_ptt5_wikilingua +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_ptt5_wikilingua` is a English model originally trained by godoyj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_ptt5_wikilingua_en_5.4.2_3.0_1724494781769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_ptt5_wikilingua_en_5.4.2_3.0_1724494781769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_model_ptt5_wikilingua","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_model_ptt5_wikilingua", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_ptt5_wikilingua| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/godoyj/test-model-ptt5-wikilingua \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_pipeline_en.md new file mode 100644 index 00000000000000..4eba0f4c192c89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_model_ptt5_wikilingua_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_model_ptt5_wikilingua_pipeline pipeline T5Transformer from godoyj +author: John Snow Labs +name: test_model_ptt5_wikilingua_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_ptt5_wikilingua_pipeline` is a English model originally trained by godoyj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_ptt5_wikilingua_pipeline_en_5.4.2_3.0_1724494960012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_ptt5_wikilingua_pipeline_en_5.4.2_3.0_1724494960012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_model_ptt5_wikilingua_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_model_ptt5_wikilingua_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_ptt5_wikilingua_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/godoyj/test-model-ptt5-wikilingua + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_en.md new file mode 100644 index 00000000000000..bb5ad6f1a0f4d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_unitranslatort5 T5Transformer from SebastiaanDenBoer +author: John Snow Labs +name: test_unitranslatort5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_unitranslatort5` is a English model originally trained by SebastiaanDenBoer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_unitranslatort5_en_5.4.2_3.0_1724525600190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_unitranslatort5_en_5.4.2_3.0_1724525600190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_unitranslatort5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_unitranslatort5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_unitranslatort5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/SebastiaanDenBoer/Test_UniTranslatorT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_pipeline_en.md new file mode 100644 index 00000000000000..7701c86baf1cc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-test_unitranslatort5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_unitranslatort5_pipeline pipeline T5Transformer from SebastiaanDenBoer +author: John Snow Labs +name: test_unitranslatort5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_unitranslatort5_pipeline` is a English model originally trained by SebastiaanDenBoer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_unitranslatort5_pipeline_en_5.4.2_3.0_1724525658155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_unitranslatort5_pipeline_en_5.4.2_3.0_1724525658155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_unitranslatort5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_unitranslatort5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_unitranslatort5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/SebastiaanDenBoer/Test_UniTranslatorT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_en.md b/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_en.md new file mode 100644 index 00000000000000..9665df35ac5860 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text2sql_4 T5Transformer from Yu-yang +author: John Snow Labs +name: text2sql_4 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_4` is a English model originally trained by Yu-yang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_4_en_5.4.2_3.0_1724495412312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_4_en_5.4.2_3.0_1724495412312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text2sql_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text2sql_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|178.6 MB| + +## References + +https://huggingface.co/Yu-yang/text2sql-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_pipeline_en.md new file mode 100644 index 00000000000000..8918ce8b90a25c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text2sql_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text2sql_4_pipeline pipeline T5Transformer from Yu-yang +author: John Snow Labs +name: text2sql_4_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_4_pipeline` is a English model originally trained by Yu-yang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_4_pipeline_en_5.4.2_3.0_1724495473199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_4_pipeline_en_5.4.2_3.0_1724495473199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text2sql_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text2sql_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|178.6 MB| + +## References + +https://huggingface.co/Yu-yang/text2sql-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_en.md new file mode 100644 index 00000000000000..1e525f19eca5ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v28 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v28 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v28` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v28_en_5.4.2_3.0_1724528632319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v28_en_5.4.2_3.0_1724528632319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v28","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v28", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v28| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v28 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_pipeline_en.md new file mode 100644 index 00000000000000..eda605aa2f974e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v28_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v28_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v28_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v28_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v28_pipeline_en_5.4.2_3.0_1724528648397.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v28_pipeline_en_5.4.2_3.0_1724528648397.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v28_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v28_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v28_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v28 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_en.md new file mode 100644 index 00000000000000..7f62c9e3a26ef6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v67 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v67 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v67` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v67_en_5.4.2_3.0_1724475528381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v67_en_5.4.2_3.0_1724475528381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v67","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v67", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v67| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|318.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v67 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_pipeline_en.md new file mode 100644 index 00000000000000..310618affe47df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v67_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v67_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v67_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v67_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v67_pipeline_en_5.4.2_3.0_1724475551552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v67_pipeline_en_5.4.2_3.0_1724475551552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v67_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v67_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v67_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v67 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_en.md new file mode 100644 index 00000000000000..9e8f90c721b316 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v6 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v6 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v6` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v6_en_5.4.2_3.0_1724488722217.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v6_en_5.4.2_3.0_1724488722217.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_pipeline_en.md new file mode 100644 index 00000000000000..6c70c6538d59bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v6_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v6_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v6_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v6_pipeline_en_5.4.2_3.0_1724488742474.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v6_pipeline_en_5.4.2_3.0_1724488742474.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_en.md new file mode 100644 index 00000000000000..61f9c212684655 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v71 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v71 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v71` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v71_en_5.4.2_3.0_1724498077930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v71_en_5.4.2_3.0_1724498077930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v71","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v71", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v71| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v71 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_pipeline_en.md new file mode 100644 index 00000000000000..1055fae5eee430 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-text_shortening_model_v71_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v71_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v71_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v71_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v71_pipeline_en_5.4.2_3.0_1724498095261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v71_pipeline_en_5.4.2_3.0_1724498095261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v71_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v71_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v71_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v71 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_en.md b/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_en.md new file mode 100644 index 00000000000000..d76aab8c4d987e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English texttotaggenerator_large T5Transformer from Ranjan22 +author: John Snow Labs +name: texttotaggenerator_large +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`texttotaggenerator_large` is a English model originally trained by Ranjan22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/texttotaggenerator_large_en_5.4.2_3.0_1724531265480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/texttotaggenerator_large_en_5.4.2_3.0_1724531265480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("texttotaggenerator_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("texttotaggenerator_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|texttotaggenerator_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/Ranjan22/TextToTagGenerator_large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_pipeline_en.md new file mode 100644 index 00000000000000..3de7670a76e2c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-texttotaggenerator_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English texttotaggenerator_large_pipeline pipeline T5Transformer from Ranjan22 +author: John Snow Labs +name: texttotaggenerator_large_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`texttotaggenerator_large_pipeline` is a English model originally trained by Ranjan22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/texttotaggenerator_large_pipeline_en_5.4.2_3.0_1724531282430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/texttotaggenerator_large_pipeline_en_5.4.2_3.0_1724531282430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("texttotaggenerator_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("texttotaggenerator_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|texttotaggenerator_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/Ranjan22/TextToTagGenerator_large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_en.md new file mode 100644 index 00000000000000..1a63d3d4e48b28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translation_grammer_jan_2024_nepal_bhasa T5Transformer from Floyd93 +author: John Snow Labs +name: translation_grammer_jan_2024_nepal_bhasa +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_grammer_jan_2024_nepal_bhasa` is a English model originally trained by Floyd93. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_grammer_jan_2024_nepal_bhasa_en_5.4.2_3.0_1724504985156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_grammer_jan_2024_nepal_bhasa_en_5.4.2_3.0_1724504985156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_grammer_jan_2024_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_grammer_jan_2024_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_grammer_jan_2024_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.1 MB| + +## References + +https://huggingface.co/Floyd93/Translation_Grammer_Jan_2024_New \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..3a016fed8c054e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-translation_grammer_jan_2024_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translation_grammer_jan_2024_nepal_bhasa_pipeline pipeline T5Transformer from Floyd93 +author: John Snow Labs +name: translation_grammer_jan_2024_nepal_bhasa_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_grammer_jan_2024_nepal_bhasa_pipeline` is a English model originally trained by Floyd93. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_grammer_jan_2024_nepal_bhasa_pipeline_en_5.4.2_3.0_1724505003387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_grammer_jan_2024_nepal_bhasa_pipeline_en_5.4.2_3.0_1724505003387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_grammer_jan_2024_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_grammer_jan_2024_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_grammer_jan_2024_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.1 MB| + +## References + +https://huggingface.co/Floyd93/Translation_Grammer_Jan_2024_New + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_en.md new file mode 100644 index 00000000000000..ae89dae7a07d13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_base_lora_experiments T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_base_lora_experiments +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_base_lora_experiments` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_base_lora_experiments_en_5.4.2_3.0_1724483110807.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_base_lora_experiments_en_5.4.2_3.0_1724483110807.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_base_lora_experiments","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_base_lora_experiments", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_base_lora_experiments| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-base-lora-experiments \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_pipeline_en.md new file mode 100644 index 00000000000000..bcfe11054d4f91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_base_lora_experiments_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_base_lora_experiments_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_base_lora_experiments_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_base_lora_experiments_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_base_lora_experiments_pipeline_en_5.4.2_3.0_1724483285570.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_base_lora_experiments_pipeline_en_5.4.2_3.0_1724483285570.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_base_lora_experiments_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_base_lora_experiments_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_base_lora_experiments_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-base-lora-experiments + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_en.md new file mode 100644 index 00000000000000..c600ffc3cd3ab2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_base_5 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base_5 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base_5` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_5_en_5.4.2_3.0_1724472572590.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_5_en_5.4.2_3.0_1724472572590.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_base_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_base_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.5 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_pipeline_en.md new file mode 100644 index 00000000000000..d36ff7f5af3686 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_base_5_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base_5_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base_5_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_5_pipeline_en_5.4.2_3.0_1724472750785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_5_pipeline_en_5.4.2_3.0_1724472750785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_base_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_base_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_en.md new file mode 100644 index 00000000000000..f284c5b9c871e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_base T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_en_5.4.2_3.0_1724494221982.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_en_5.4.2_3.0_1724494221982.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.5 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_pipeline_en.md new file mode 100644 index 00000000000000..70964d83a14816 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-turkmen_instruct_squad_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_base_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_pipeline_en_5.4.2_3.0_1724494396964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_pipeline_en_5.4.2_3.0_1724494396964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_pipeline_uk.md b/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_pipeline_uk.md new file mode 100644 index 00000000000000..29a52154c87289 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_pipeline_uk.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Ukrainian ukr_t5_small_pipeline pipeline T5Transformer from d0p3 +author: John Snow Labs +name: ukr_t5_small_pipeline +date: 2024-08-24 +tags: [uk, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: uk +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukr_t5_small_pipeline` is a Ukrainian model originally trained by d0p3. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukr_t5_small_pipeline_uk_5.4.2_3.0_1724459950924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukr_t5_small_pipeline_uk_5.4.2_3.0_1724459950924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ukr_t5_small_pipeline", lang = "uk") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ukr_t5_small_pipeline", lang = "uk") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukr_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|uk| +|Size:|172.8 MB| + +## References + +https://huggingface.co/d0p3/ukr-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_uk.md b/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_uk.md new file mode 100644 index 00000000000000..719462189be7bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ukr_t5_small_uk.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Ukrainian ukr_t5_small T5Transformer from d0p3 +author: John Snow Labs +name: ukr_t5_small +date: 2024-08-24 +tags: [uk, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: uk +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukr_t5_small` is a Ukrainian model originally trained by d0p3. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukr_t5_small_uk_5.4.2_3.0_1724459891953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukr_t5_small_uk_5.4.2_3.0_1724459891953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ukr_t5_small","uk") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ukr_t5_small", "uk") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukr_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|uk| +|Size:|172.8 MB| + +## References + +https://huggingface.co/d0p3/ukr-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_en.md b/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_en.md new file mode 100644 index 00000000000000..574bfb6dfc061f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ukrainian_mt5_small_gec T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_small_gec +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_small_gec` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_small_gec_en_5.4.2_3.0_1724473453771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_small_gec_en_5.4.2_3.0_1724473453771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ukrainian_mt5_small_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ukrainian_mt5_small_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_small_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|315.5 MB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-small-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_pipeline_en.md new file mode 100644 index 00000000000000..65239ad75ac81d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ukrainian_mt5_small_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ukrainian_mt5_small_gec_pipeline pipeline T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_small_gec_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_small_gec_pipeline` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_small_gec_pipeline_en_5.4.2_3.0_1724473469961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_small_gec_pipeline_en_5.4.2_3.0_1724473469961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ukrainian_mt5_small_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ukrainian_mt5_small_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_small_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|315.5 MB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-small-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_nl.md b/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_nl.md new file mode 100644 index 00000000000000..2ae17cfa61f159 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_nl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Dutch, Flemish ul2_base_dutch_english T5Transformer from yhavinga +author: John Snow Labs +name: ul2_base_dutch_english +date: 2024-08-24 +tags: [nl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_base_dutch_english` is a Dutch, Flemish model originally trained by yhavinga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_base_dutch_english_nl_5.4.2_3.0_1724498832714.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_base_dutch_english_nl_5.4.2_3.0_1724498832714.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ul2_base_dutch_english","nl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ul2_base_dutch_english", "nl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_base_dutch_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nl| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yhavinga/ul2-base-dutch-english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_pipeline_nl.md b/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_pipeline_nl.md new file mode 100644 index 00000000000000..aecbdd49bab465 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ul2_base_dutch_english_pipeline_nl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Dutch, Flemish ul2_base_dutch_english_pipeline pipeline T5Transformer from yhavinga +author: John Snow Labs +name: ul2_base_dutch_english_pipeline +date: 2024-08-24 +tags: [nl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_base_dutch_english_pipeline` is a Dutch, Flemish model originally trained by yhavinga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_base_dutch_english_pipeline_nl_5.4.2_3.0_1724498889063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_base_dutch_english_pipeline_nl_5.4.2_3.0_1724498889063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ul2_base_dutch_english_pipeline", lang = "nl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ul2_base_dutch_english_pipeline", lang = "nl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_base_dutch_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nl| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yhavinga/ul2-base-dutch-english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_nl.md b/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_nl.md new file mode 100644 index 00000000000000..3e1ca50d4436d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_nl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Dutch, Flemish ul2_large_dutch_simplification_maithili_2023 T5Transformer from BramVanroy +author: John Snow Labs +name: ul2_large_dutch_simplification_maithili_2023 +date: 2024-08-24 +tags: [nl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_large_dutch_simplification_maithili_2023` is a Dutch, Flemish model originally trained by BramVanroy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_large_dutch_simplification_maithili_2023_nl_5.4.2_3.0_1724537177785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_large_dutch_simplification_maithili_2023_nl_5.4.2_3.0_1724537177785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ul2_large_dutch_simplification_maithili_2023","nl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ul2_large_dutch_simplification_maithili_2023", "nl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_large_dutch_simplification_maithili_2023| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nl| +|Size:|3.1 GB| + +## References + +https://huggingface.co/BramVanroy/ul2-large-dutch-simplification-mai-2023 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_pipeline_nl.md b/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_pipeline_nl.md new file mode 100644 index 00000000000000..ab89c32d705d4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-ul2_large_dutch_simplification_maithili_2023_pipeline_nl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Dutch, Flemish ul2_large_dutch_simplification_maithili_2023_pipeline pipeline T5Transformer from BramVanroy +author: John Snow Labs +name: ul2_large_dutch_simplification_maithili_2023_pipeline +date: 2024-08-24 +tags: [nl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ul2_large_dutch_simplification_maithili_2023_pipeline` is a Dutch, Flemish model originally trained by BramVanroy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ul2_large_dutch_simplification_maithili_2023_pipeline_nl_5.4.2_3.0_1724537320912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ul2_large_dutch_simplification_maithili_2023_pipeline_nl_5.4.2_3.0_1724537320912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ul2_large_dutch_simplification_maithili_2023_pipeline", lang = "nl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ul2_large_dutch_simplification_maithili_2023_pipeline", lang = "nl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ul2_large_dutch_simplification_maithili_2023_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nl| +|Size:|3.1 GB| + +## References + +https://huggingface.co/BramVanroy/ul2-large-dutch-simplification-mai-2023 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_en.md b/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_en.md new file mode 100644 index 00000000000000..51a7249a86a8ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English underline_tonga_tonga_islands_emphasis_model T5Transformer from tvergho +author: John Snow Labs +name: underline_tonga_tonga_islands_emphasis_model +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`underline_tonga_tonga_islands_emphasis_model` is a English model originally trained by tvergho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/underline_tonga_tonga_islands_emphasis_model_en_5.4.2_3.0_1724470901924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/underline_tonga_tonga_islands_emphasis_model_en_5.4.2_3.0_1724470901924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("underline_tonga_tonga_islands_emphasis_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("underline_tonga_tonga_islands_emphasis_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|underline_tonga_tonga_islands_emphasis_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tvergho/underline_to_emphasis_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_pipeline_en.md new file mode 100644 index 00000000000000..c67b01b148d78d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-underline_tonga_tonga_islands_emphasis_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English underline_tonga_tonga_islands_emphasis_model_pipeline pipeline T5Transformer from tvergho +author: John Snow Labs +name: underline_tonga_tonga_islands_emphasis_model_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`underline_tonga_tonga_islands_emphasis_model_pipeline` is a English model originally trained by tvergho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/underline_tonga_tonga_islands_emphasis_model_pipeline_en_5.4.2_3.0_1724470949284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/underline_tonga_tonga_islands_emphasis_model_pipeline_en_5.4.2_3.0_1724470949284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("underline_tonga_tonga_islands_emphasis_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("underline_tonga_tonga_islands_emphasis_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|underline_tonga_tonga_islands_emphasis_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tvergho/underline_to_emphasis_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_en.md b/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_en.md new file mode 100644 index 00000000000000..e4c331216dca6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vanilla_mt5_tiny6l_vs32k T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny6l_vs32k +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny6l_vs32k` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny6l_vs32k_en_5.4.2_3.0_1724506165719.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny6l_vs32k_en_5.4.2_3.0_1724506165719.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vanilla_mt5_tiny6l_vs32k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vanilla_mt5_tiny6l_vs32k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny6l_vs32k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|125.3 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny6L-vs32k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_pipeline_en.md new file mode 100644 index 00000000000000..6a1c9aaf754fcb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vanilla_mt5_tiny6l_vs32k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vanilla_mt5_tiny6l_vs32k_pipeline pipeline T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny6l_vs32k_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny6l_vs32k_pipeline` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny6l_vs32k_pipeline_en_5.4.2_3.0_1724506172334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny6l_vs32k_pipeline_en_5.4.2_3.0_1724506172334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vanilla_mt5_tiny6l_vs32k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vanilla_mt5_tiny6l_vs32k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny6l_vs32k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|125.4 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny6L-vs32k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_en.md new file mode 100644 index 00000000000000..bf826bde4627fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_translation_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_translation_news_train +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_translation_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_news_train_en_5.4.2_3.0_1724496510304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_news_train_en_5.4.2_3.0_1724496510304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_translation_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_translation_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_translation_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-translation_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_pipeline_en.md new file mode 100644 index 00000000000000..14f4f6fed7e056 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_envit5_translation_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_translation_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_translation_news_train_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_translation_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_news_train_pipeline_en_5.4.2_3.0_1724496585199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_news_train_pipeline_en_5.4.2_3.0_1724496585199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_translation_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_translation_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_translation_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-translation_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_en.md b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_en.md new file mode 100644 index 00000000000000..6420ab4e6a141b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_conv_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_conv_train +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_conv_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_conv_train_en_5.4.2_3.0_1724512489474.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_conv_train_en_5.4.2_3.0_1724512489474.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_conv_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_conv_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_conv_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_conv_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_pipeline_en.md new file mode 100644 index 00000000000000..6abc02940fe686 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-vietnamese_english_mt5_base_conv_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_conv_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_conv_train_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_conv_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_conv_train_pipeline_en_5.4.2_3.0_1724512767571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_conv_train_pipeline_en_5.4.2_3.0_1724512767571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_mt5_base_conv_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_mt5_base_conv_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_conv_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_conv_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_en.md new file mode 100644 index 00000000000000..1832f83c87b7ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wikinews_t5_small T5Transformer from drive087 +author: John Snow Labs +name: wikinews_t5_small +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wikinews_t5_small` is a English model originally trained by drive087. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wikinews_t5_small_en_5.4.2_3.0_1724518468557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wikinews_t5_small_en_5.4.2_3.0_1724518468557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wikinews_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wikinews_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wikinews_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|285.1 MB| + +## References + +https://huggingface.co/drive087/wikinews_t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..f6ff67e7a072a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-wikinews_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wikinews_t5_small_pipeline pipeline T5Transformer from drive087 +author: John Snow Labs +name: wikinews_t5_small_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wikinews_t5_small_pipeline` is a English model originally trained by drive087. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wikinews_t5_small_pipeline_en_5.4.2_3.0_1724518498408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wikinews_t5_small_pipeline_en_5.4.2_3.0_1724518498408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wikinews_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wikinews_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wikinews_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|285.1 MB| + +## References + +https://huggingface.co/drive087/wikinews_t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_en.md b/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_en.md new file mode 100644 index 00000000000000..3ff9d186ee83b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_aligned_smallt5_iter2 T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_iter2 +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_iter2` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_iter2_en_5.4.2_3.0_1724474402829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_iter2_en_5.4.2_3.0_1724474402829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_aligned_smallt5_iter2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_aligned_smallt5_iter2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_iter2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_iter2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_pipeline_en.md new file mode 100644 index 00000000000000..231d2a41a420f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-xsum_aligned_smallt5_iter2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_aligned_smallt5_iter2_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_iter2_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_iter2_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_iter2_pipeline_en_5.4.2_3.0_1724474425364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_iter2_pipeline_en_5.4.2_3.0_1724474425364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_aligned_smallt5_iter2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_aligned_smallt5_iter2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_iter2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_iter2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_en.md b/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_en.md new file mode 100644 index 00000000000000..7052380ca05265 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second T5Transformer from KingKazma +author: John Snow Labs +name: xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second +date: 2024-08-24 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_en_5.4.2_3.0_1724458475653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_en_5.4.2_3.0_1724458475653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KingKazma/xsum_t5-small_fine_tuning_500_10_50000_8_e-1_s6789_v4_l4_second \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline_en.md new file mode 100644 index 00000000000000..1d96476f3725fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-24-xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline pipeline T5Transformer from KingKazma +author: John Snow Labs +name: xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline +date: 2024-08-24 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline_en_5.4.2_3.0_1724458492690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline_en_5.4.2_3.0_1724458492690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_t5_small_fine_tuning_500_10_50000_8_e_1_s6789_v4_l4_second_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KingKazma/xsum_t5-small_fine_tuning_500_10_50000_8_e-1_s6789_v4_l4_second + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-20240116_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-20240116_0_en.md new file mode 100644 index 00000000000000..d785021618d4ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-20240116_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240116_0 T5Transformer from picas9dan +author: John Snow Labs +name: 20240116_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_0` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_0_en_5.4.2_3.0_1724594577607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_0_en_5.4.2_3.0_1724594577607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240116_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240116_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240116_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240116_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-20240116_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-20240116_0_pipeline_en.md new file mode 100644 index 00000000000000..a18d427d68f83f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-20240116_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240116_0_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240116_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_0_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_0_pipeline_en_5.4.2_3.0_1724594594466.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_0_pipeline_en_5.4.2_3.0_1724594594466.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240116_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240116_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240116_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240116_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_en.md b/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_en.md new file mode 100644 index 00000000000000..f7955c0dc5f036 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrimt5_twi_english_news T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_twi_english_news +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_twi_english_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_twi_english_news_en_5.4.2_3.0_1724567292702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_twi_english_news_en_5.4.2_3.0_1724567292702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrimt5_twi_english_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrimt5_twi_english_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_twi_english_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_twi_en_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_pipeline_en.md new file mode 100644 index 00000000000000..4329aec31f3b44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-afrimt5_twi_english_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrimt5_twi_english_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_twi_english_news_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_twi_english_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_twi_english_news_pipeline_en_5.4.2_3.0_1724567437443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_twi_english_news_pipeline_en_5.4.2_3.0_1724567437443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrimt5_twi_english_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrimt5_twi_english_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_twi_english_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_twi_en_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-albert_token_classifier_base_by_hooshvarelab_en.md b/docs/_posts/ahmedlone127/2024-08-25-albert_token_classifier_base_by_hooshvarelab_en.md new file mode 100644 index 00000000000000..0aed9fa21547df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-albert_token_classifier_base_by_hooshvarelab_en.md @@ -0,0 +1,104 @@ +--- +layout: model +title: ALBERT Token Classification Base (albert_token_classifier_base_by_hooshvarelab) +author: John Snow Labs +name: albert_token_classifier_base_by_hooshvarelab +date: 2024-08-25 +tags: [token_classification, albert, openvino, en, open_source] +task: Named Entity Recognition +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: openvino +annotator: AlbertForTokenClassification +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +“ + + ALBERT Model with a token classification head on top (a linear layer on top of the hidden-states output) e.g. for Named-Entity-Recognition (NER) tasks. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/albert_token_classifier_base_by_hooshvarelab_en_5.4.2_3.0_1724604140907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/albert_token_classifier_base_by_hooshvarelab_en_5.4.2_3.0_1724604140907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + + +document_assembler = DocumentAssembler() .setInputCol('text') .setOutputCol('document') + +tokenizer = Tokenizer() .setInputCols(['document']) .setOutputCol('token') + +tokenClassifier = AlbertForTokenClassification .pretrained('albert_token_classifier_base_by_hooshvarelab', 'en') .setInputCols(['token', 'document']) .setOutputCol('ner') .setCaseSensitive(True) .setMaxSentenceLength(512) + +# since output column is IOB/IOB2 style, NerConverter can extract entities +ner_converter = NerConverter() .setInputCols(['document', 'token', 'ner']) .setOutputCol('entities') + +pipeline = Pipeline(stages=[ +document_assembler, +tokenizer, +tokenClassifier, +ner_converter +]) + +example = spark.createDataFrame([['My name is John!']]).toDF("text") +result = pipeline.fit(example).transform(example) + +``` +```scala + +val document_assembler = DocumentAssembler() +.setInputCol("text") +.setOutputCol("document") + +val tokenizer = Tokenizer() +.setInputCols("document") +.setOutputCol("token") + +val tokenClassifier = AlbertForTokenClassification.pretrained("albert_token_classifier_base_by_hooshvarelab", "en") +.setInputCols("document", "token") +.setOutputCol("ner") +.setCaseSensitive(true) +.setMaxSentenceLength(512) + +// since output column is IOB/IOB2 style, NerConverter can extract entities +val ner_converter = NerConverter() +.setInputCols("document", "token", "ner") +.setOutputCol("entities") + +val pipeline = new Pipeline().setStages(Array(document_assembler, tokenizer, tokenClassifier, ner_converter)) + +val example = Seq.empty["My name is John!"].toDS.toDF("text") + +val result = pipeline.fit(example).transform(example) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|albert_token_classifier_base_by_hooshvarelab| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[token, document]| +|Output Labels:|[label]| +|Language:|en| +|Size:|41.9 MB| +|Case sensitive:|true| \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_en.md b/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_en.md new file mode 100644 index 00000000000000..7e9ff7f44466ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_15_spider T5Transformer from NatthawatTung +author: John Snow Labs +name: all_mt5_base_15_spider +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider` is a English model originally trained by NatthawatTung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_en_5.4.2_3.0_1724554996413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_en_5.4.2_3.0_1724554996413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_15_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_15_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/NatthawatTung/ALL_mt5-base_15_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_pipeline_en.md new file mode 100644 index 00000000000000..4a303f8e5f8824 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-all_mt5_base_15_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_15_spider_pipeline pipeline T5Transformer from NatthawatTung +author: John Snow Labs +name: all_mt5_base_15_spider_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_pipeline` is a English model originally trained by NatthawatTung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_pipeline_en_5.4.2_3.0_1724555298116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_pipeline_en_5.4.2_3.0_1724555298116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_15_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_15_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/NatthawatTung/ALL_mt5-base_15_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_en.md b/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_en.md new file mode 100644 index 00000000000000..396f94df6b4eb9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5base T5Transformer from webnlg +author: John Snow Labs +name: all_mt5base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5base` is a English model originally trained by webnlg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5base_en_5.4.2_3.0_1724564660756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5base_en_5.4.2_3.0_1724564660756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/webnlg/all-mt5base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_pipeline_en.md new file mode 100644 index 00000000000000..254d6f5d59b83a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-all_mt5base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5base_pipeline pipeline T5Transformer from webnlg +author: John Snow Labs +name: all_mt5base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5base_pipeline` is a English model originally trained by webnlg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5base_pipeline_en_5.4.2_3.0_1724564894183.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5base_pipeline_en_5.4.2_3.0_1724564894183.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/webnlg/all-mt5base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_en.md b/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_en.md new file mode 100644 index 00000000000000..a4232a114a1ac3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English alphaedu_vit5 T5Transformer from Linhz +author: John Snow Labs +name: alphaedu_vit5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`alphaedu_vit5` is a English model originally trained by Linhz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/alphaedu_vit5_en_5.4.2_3.0_1724614579067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/alphaedu_vit5_en_5.4.2_3.0_1724614579067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("alphaedu_vit5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("alphaedu_vit5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|alphaedu_vit5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Linhz/AlphaEdu_ViT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_pipeline_en.md new file mode 100644 index 00000000000000..30cf56dec3a767 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-alphaedu_vit5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English alphaedu_vit5_pipeline pipeline T5Transformer from Linhz +author: John Snow Labs +name: alphaedu_vit5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`alphaedu_vit5_pipeline` is a English model originally trained by Linhz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/alphaedu_vit5_pipeline_en_5.4.2_3.0_1724614634796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/alphaedu_vit5_pipeline_en_5.4.2_3.0_1724614634796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("alphaedu_vit5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("alphaedu_vit5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|alphaedu_vit5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Linhz/AlphaEdu_ViT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_en.md b/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_en.md new file mode 100644 index 00000000000000..6e178d66440648 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English amtibot_t5 T5Transformer from josiahgottfried +author: John Snow Labs +name: amtibot_t5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amtibot_t5` is a English model originally trained by josiahgottfried. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amtibot_t5_en_5.4.2_3.0_1724567010700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amtibot_t5_en_5.4.2_3.0_1724567010700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("amtibot_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("amtibot_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amtibot_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|942.1 MB| + +## References + +https://huggingface.co/josiahgottfried/amtibot_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_pipeline_en.md new file mode 100644 index 00000000000000..efc4d3c98a692f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-amtibot_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English amtibot_t5_pipeline pipeline T5Transformer from josiahgottfried +author: John Snow Labs +name: amtibot_t5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amtibot_t5_pipeline` is a English model originally trained by josiahgottfried. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amtibot_t5_pipeline_en_5.4.2_3.0_1724567072324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amtibot_t5_pipeline_en_5.4.2_3.0_1724567072324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("amtibot_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("amtibot_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amtibot_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|942.1 MB| + +## References + +https://huggingface.co/josiahgottfried/amtibot_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_en.md b/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_en.md new file mode 100644 index 00000000000000..f287ffcd69416b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_arabic_summarization_wiki_lingua T5Transformer from karim-Mohamed2018 +author: John Snow Labs +name: arat5_arabic_summarization_wiki_lingua +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_arabic_summarization_wiki_lingua` is a English model originally trained by karim-Mohamed2018. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_arabic_summarization_wiki_lingua_en_5.4.2_3.0_1724582634174.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_arabic_summarization_wiki_lingua_en_5.4.2_3.0_1724582634174.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_arabic_summarization_wiki_lingua","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_arabic_summarization_wiki_lingua", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_arabic_summarization_wiki_lingua| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/karim-Mohamed2018/Arat5-arabic-summarization-wiki-lingua \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_pipeline_en.md new file mode 100644 index 00000000000000..5e69f5e6a7f1e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-arat5_arabic_summarization_wiki_lingua_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_arabic_summarization_wiki_lingua_pipeline pipeline T5Transformer from karim-Mohamed2018 +author: John Snow Labs +name: arat5_arabic_summarization_wiki_lingua_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_arabic_summarization_wiki_lingua_pipeline` is a English model originally trained by karim-Mohamed2018. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_arabic_summarization_wiki_lingua_pipeline_en_5.4.2_3.0_1724582712383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_arabic_summarization_wiki_lingua_pipeline_en_5.4.2_3.0_1724582712383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_arabic_summarization_wiki_lingua_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_arabic_summarization_wiki_lingua_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_arabic_summarization_wiki_lingua_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/karim-Mohamed2018/Arat5-arabic-summarization-wiki-lingua + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_en.md new file mode 100644 index 00000000000000..57d85efb56f414 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_with_edge_label_sentence_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_with_edge_label_sentence_level_t5_run1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_with_edge_label_sentence_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_with_edge_label_sentence_level_t5_run1_en_5.4.2_3.0_1724565851086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_with_edge_label_sentence_level_t5_run1_en_5.4.2_3.0_1724565851086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_with_edge_label_sentence_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_with_edge_label_sentence_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_with_edge_label_sentence_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.3 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_with_edge_label_sentence_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..c8d7a625fd9b19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline_en_5.4.2_3.0_1724565869244.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline_en_5.4.2_3.0_1724565869244.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_with_edge_label_sentence_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.3 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_with_edge_label_sentence_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_en.md new file mode 100644 index 00000000000000..6116b35121136d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_without_edge_label_sentence_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_without_edge_label_sentence_level_t5_run2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_without_edge_label_sentence_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_without_edge_label_sentence_level_t5_run2_en_5.4.2_3.0_1724624129480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_without_edge_label_sentence_level_t5_run2_en_5.4.2_3.0_1724624129480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_without_edge_label_sentence_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_without_edge_label_sentence_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_without_edge_label_sentence_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.9 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_without_edge_label_sentence_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..ad0fadb27d5b9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline_en_5.4.2_3.0_1724624147476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline_en_5.4.2_3.0_1724624147476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_without_edge_label_sentence_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.9 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_without_edge_label_sentence_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-author_base_try_en.md b/docs/_posts/ahmedlone127/2024-08-25-author_base_try_en.md new file mode 100644 index 00000000000000..e2a97468ff972c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-author_base_try_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English author_base_try T5Transformer from Anna-UoC +author: John Snow Labs +name: author_base_try +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`author_base_try` is a English model originally trained by Anna-UoC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/author_base_try_en_5.4.2_3.0_1724605569838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/author_base_try_en_5.4.2_3.0_1724605569838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("author_base_try","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("author_base_try", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|author_base_try| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Anna-UoC/author_base_try \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-author_base_try_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-author_base_try_pipeline_en.md new file mode 100644 index 00000000000000..e134a27cba5bdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-author_base_try_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English author_base_try_pipeline pipeline T5Transformer from Anna-UoC +author: John Snow Labs +name: author_base_try_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`author_base_try_pipeline` is a English model originally trained by Anna-UoC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/author_base_try_pipeline_en_5.4.2_3.0_1724605619249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/author_base_try_pipeline_en_5.4.2_3.0_1724605619249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("author_base_try_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("author_base_try_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|author_base_try_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Anna-UoC/author_base_try + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_en.md b/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_en.md new file mode 100644 index 00000000000000..577eac1a2c34e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_test44_50597120816 T5Transformer from breadlicker45 +author: John Snow Labs +name: autotrain_test44_50597120816 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_test44_50597120816` is a English model originally trained by breadlicker45. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_test44_50597120816_en_5.4.2_3.0_1724602628557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_test44_50597120816_en_5.4.2_3.0_1724602628557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_test44_50597120816","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_test44_50597120816", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_test44_50597120816| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/breadlicker45/autotrain-test44-50597120816 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_pipeline_en.md new file mode 100644 index 00000000000000..a4e41b688ebfb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-autotrain_test44_50597120816_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_test44_50597120816_pipeline pipeline T5Transformer from breadlicker45 +author: John Snow Labs +name: autotrain_test44_50597120816_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_test44_50597120816_pipeline` is a English model originally trained by breadlicker45. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_test44_50597120816_pipeline_en_5.4.2_3.0_1724602780785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_test44_50597120816_pipeline_en_5.4.2_3.0_1724602780785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_test44_50597120816_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_test44_50597120816_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_test44_50597120816_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/breadlicker45/autotrain-test44-50597120816 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_en.md b/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_en.md new file mode 100644 index 00000000000000..136efbd33ebf49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English baltic_languages_pre_trained T5Transformer from elena-soare +author: John Snow Labs +name: baltic_languages_pre_trained +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`baltic_languages_pre_trained` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/baltic_languages_pre_trained_en_5.4.2_3.0_1724582651385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/baltic_languages_pre_trained_en_5.4.2_3.0_1724582651385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("baltic_languages_pre_trained","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("baltic_languages_pre_trained", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|baltic_languages_pre_trained| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/elena-soare/bat-pre-trained \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_pipeline_en.md new file mode 100644 index 00000000000000..8a9341061dd970 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-baltic_languages_pre_trained_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English baltic_languages_pre_trained_pipeline pipeline T5Transformer from elena-soare +author: John Snow Labs +name: baltic_languages_pre_trained_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`baltic_languages_pre_trained_pipeline` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/baltic_languages_pre_trained_pipeline_en_5.4.2_3.0_1724582699671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/baltic_languages_pre_trained_pipeline_en_5.4.2_3.0_1724582699671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("baltic_languages_pre_trained_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("baltic_languages_pre_trained_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|baltic_languages_pre_trained_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/elena-soare/bat-pre-trained + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_en.md new file mode 100644 index 00000000000000..13b2730f4fac9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_idiom_paraphrase_v1_syeda_raisa T5Transformer from syeda-raisa +author: John Snow Labs +name: bangla_idiom_paraphrase_v1_syeda_raisa +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_paraphrase_v1_syeda_raisa` is a English model originally trained by syeda-raisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_syeda_raisa_en_5.4.2_3.0_1724560484173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_syeda_raisa_en_5.4.2_3.0_1724560484173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_idiom_paraphrase_v1_syeda_raisa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_idiom_paraphrase_v1_syeda_raisa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_paraphrase_v1_syeda_raisa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/syeda-raisa/bangla_idiom_paraphrase_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_pipeline_en.md new file mode 100644 index 00000000000000..a6e2f0c42aa6f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_idiom_paraphrase_v1_syeda_raisa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_idiom_paraphrase_v1_syeda_raisa_pipeline pipeline T5Transformer from syeda-raisa +author: John Snow Labs +name: bangla_idiom_paraphrase_v1_syeda_raisa_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_paraphrase_v1_syeda_raisa_pipeline` is a English model originally trained by syeda-raisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_syeda_raisa_pipeline_en_5.4.2_3.0_1724560531027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_syeda_raisa_pipeline_en_5.4.2_3.0_1724560531027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_idiom_paraphrase_v1_syeda_raisa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_idiom_paraphrase_v1_syeda_raisa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_paraphrase_v1_syeda_raisa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/syeda-raisa/bangla_idiom_paraphrase_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_en.md new file mode 100644 index 00000000000000..fbbd8876d6f073 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v2_test_2 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v2_test_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v2_test_2` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v2_test_2_en_5.4.2_3.0_1724597980063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v2_test_2_en_5.4.2_3.0_1724597980063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v2_test_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v2_test_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v2_test_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v2-test-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_pipeline_en.md new file mode 100644 index 00000000000000..1cba6584f99a5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v2_test_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v2_test_2_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v2_test_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v2_test_2_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v2_test_2_pipeline_en_5.4.2_3.0_1724598028169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v2_test_2_pipeline_en_5.4.2_3.0_1724598028169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v2_test_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v2_test_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v2_test_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v2-test-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_en.md new file mode 100644 index 00000000000000..f6f78f9166582f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_450000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_450000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_450000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_450000_en_5.4.2_3.0_1724607813775.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_450000_en_5.4.2_3.0_1724607813775.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_450000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_450000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_450000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-450000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_pipeline_en.md new file mode 100644 index 00000000000000..2a0d78fa0d2cca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-bangla_para_v3_450000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_450000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_450000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_450000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_450000_pipeline_en_5.4.2_3.0_1724607863437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_450000_pipeline_en_5.4.2_3.0_1724607863437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_450000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_450000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_450000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-450000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_en.md new file mode 100644 index 00000000000000..aae59bf7bfd349 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5_finetuned_headlinebt5 T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_finetuned_headlinebt5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_finetuned_headlinebt5` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_en_5.4.2_3.0_1724557733478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_en_5.4.2_3.0_1724557733478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5_finetuned_headlinebt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5_finetuned_headlinebt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_finetuned_headlinebt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|960.4 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-finetuned-headlineBT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_pipeline_en.md new file mode 100644 index 00000000000000..9401a5fb605d7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5_finetuned_headlinebt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5_finetuned_headlinebt5_pipeline pipeline T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_finetuned_headlinebt5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_finetuned_headlinebt5_pipeline` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_pipeline_en_5.4.2_3.0_1724557787886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_pipeline_en_5.4.2_3.0_1724557787886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5_finetuned_headlinebt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5_finetuned_headlinebt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_finetuned_headlinebt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|960.4 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-finetuned-headlineBT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_en.md new file mode 100644 index 00000000000000..904fde0ac938f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5_headlinebt5_withip T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_headlinebt5_withip +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_headlinebt5_withip` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_headlinebt5_withip_en_5.4.2_3.0_1724595737841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_headlinebt5_withip_en_5.4.2_3.0_1724595737841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5_headlinebt5_withip","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5_headlinebt5_withip", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_headlinebt5_withip| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|981.9 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-headlineBT5_WithIp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_pipeline_en.md new file mode 100644 index 00000000000000..0378358702280a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5_headlinebt5_withip_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5_headlinebt5_withip_pipeline pipeline T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_headlinebt5_withip_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_headlinebt5_withip_pipeline` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_headlinebt5_withip_pipeline_en_5.4.2_3.0_1724595794309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_headlinebt5_withip_pipeline_en_5.4.2_3.0_1724595794309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5_headlinebt5_withip_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5_headlinebt5_withip_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_headlinebt5_withip_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|981.9 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-headlineBT5_WithIp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_en.md new file mode 100644 index 00000000000000..74361d6009c844 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5summarygenerator T5Transformer from JS47 +author: John Snow Labs +name: banglat5summarygenerator +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5summarygenerator` is a English model originally trained by JS47. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5summarygenerator_en_5.4.2_3.0_1724581505520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5summarygenerator_en_5.4.2_3.0_1724581505520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5summarygenerator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5summarygenerator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5summarygenerator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|521.2 MB| + +## References + +https://huggingface.co/JS47/BanglaT5SummaryGenerator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_pipeline_en.md new file mode 100644 index 00000000000000..b25fb3e0255199 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-banglat5summarygenerator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5summarygenerator_pipeline pipeline T5Transformer from JS47 +author: John Snow Labs +name: banglat5summarygenerator_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5summarygenerator_pipeline` is a English model originally trained by JS47. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5summarygenerator_pipeline_en_5.4.2_3.0_1724581673368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5summarygenerator_pipeline_en_5.4.2_3.0_1724581673368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5summarygenerator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5summarygenerator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5summarygenerator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|521.2 MB| + +## References + +https://huggingface.co/JS47/BanglaT5SummaryGenerator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_en.md new file mode 100644 index 00000000000000..ae26aba3cd6c66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English billsum_4875_t5_v1_1_base T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_4875_t5_v1_1_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_4875_t5_v1_1_base` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_4875_t5_v1_1_base_en_5.4.2_3.0_1724547098506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_4875_t5_v1_1_base_en_5.4.2_3.0_1724547098506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("billsum_4875_t5_v1_1_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("billsum_4875_t5_v1_1_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_4875_t5_v1_1_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/ryusangwon/billsum_4875_t5-v1_1-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_pipeline_en.md new file mode 100644 index 00000000000000..1a91f0d1c3cdd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-billsum_4875_t5_v1_1_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English billsum_4875_t5_v1_1_base_pipeline pipeline T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_4875_t5_v1_1_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_4875_t5_v1_1_base_pipeline` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_4875_t5_v1_1_base_pipeline_en_5.4.2_3.0_1724547146054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_4875_t5_v1_1_base_pipeline_en_5.4.2_3.0_1724547146054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("billsum_4875_t5_v1_1_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("billsum_4875_t5_v1_1_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_4875_t5_v1_1_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/ryusangwon/billsum_4875_t5-v1_1-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_en.md new file mode 100644 index 00000000000000..fc49b79cf84134 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_plus_large T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_large` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_large_en_5.4.2_3.0_1724629319012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_large_en_5.4.2_3.0_1724629319012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_plus_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_plus_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_pipeline_en.md new file mode 100644 index 00000000000000..4a7f67a9c2f422 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-biot5_plus_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_plus_large_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_large_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_large_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_large_pipeline_en_5.4.2_3.0_1724629457874.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_large_pipeline_en_5.4.2_3.0_1724629457874.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_plus_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_plus_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_en.md new file mode 100644 index 00000000000000..aa7fc46a1b1812 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_seabornresponsibility T5Transformer from seabornresponsibility +author: John Snow Labs +name: burmese_awesome_billsum_model_seabornresponsibility +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_seabornresponsibility` is a English model originally trained by seabornresponsibility. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_seabornresponsibility_en_5.4.2_3.0_1724601220756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_seabornresponsibility_en_5.4.2_3.0_1724601220756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_seabornresponsibility","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_seabornresponsibility", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_seabornresponsibility| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.3 MB| + +## References + +https://huggingface.co/seabornresponsibility/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_pipeline_en.md new file mode 100644 index 00000000000000..ede630791a06f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_billsum_model_seabornresponsibility_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_seabornresponsibility_pipeline pipeline T5Transformer from seabornresponsibility +author: John Snow Labs +name: burmese_awesome_billsum_model_seabornresponsibility_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_seabornresponsibility_pipeline` is a English model originally trained by seabornresponsibility. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_seabornresponsibility_pipeline_en_5.4.2_3.0_1724601244440.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_seabornresponsibility_pipeline_en_5.4.2_3.0_1724601244440.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_seabornresponsibility_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_seabornresponsibility_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_seabornresponsibility_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.3 MB| + +## References + +https://huggingface.co/seabornresponsibility/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_en.md new file mode 100644 index 00000000000000..c943fa9656fd21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_model_mimi1998 T5Transformer from mimi1998 +author: John Snow Labs +name: burmese_awesome_model_mimi1998 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_mimi1998` is a English model originally trained by mimi1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_mimi1998_en_5.4.2_3.0_1724598239446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_mimi1998_en_5.4.2_3.0_1724598239446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_model_mimi1998","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_model_mimi1998", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_mimi1998| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/mimi1998/my_awesome_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_pipeline_en.md new file mode 100644 index 00000000000000..afb50201ef5254 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_model_mimi1998_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_model_mimi1998_pipeline pipeline T5Transformer from mimi1998 +author: John Snow Labs +name: burmese_awesome_model_mimi1998_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_mimi1998_pipeline` is a English model originally trained by mimi1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_mimi1998_pipeline_en_5.4.2_3.0_1724598296674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_mimi1998_pipeline_en_5.4.2_3.0_1724598296674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_model_mimi1998_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_model_mimi1998_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_mimi1998_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/mimi1998/my_awesome_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_en.md new file mode 100644 index 00000000000000..de90121fbffb8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_liang0128 T5Transformer from liang0128 +author: John Snow Labs +name: burmese_awesome_opus_books_model_liang0128 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_liang0128` is a English model originally trained by liang0128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_liang0128_en_5.4.2_3.0_1724567004025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_liang0128_en_5.4.2_3.0_1724567004025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_liang0128","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_liang0128", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_liang0128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liang0128/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_pipeline_en.md new file mode 100644 index 00000000000000..e33572d375f386 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_liang0128_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_liang0128_pipeline pipeline T5Transformer from liang0128 +author: John Snow Labs +name: burmese_awesome_opus_books_model_liang0128_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_liang0128_pipeline` is a English model originally trained by liang0128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_liang0128_pipeline_en_5.4.2_3.0_1724567055151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_liang0128_pipeline_en_5.4.2_3.0_1724567055151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_liang0128_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_liang0128_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_liang0128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liang0128/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_en.md new file mode 100644 index 00000000000000..d890392e6254e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_osquery T5Transformer from Osquery +author: John Snow Labs +name: burmese_awesome_opus_books_model_osquery +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_osquery` is a English model originally trained by Osquery. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_osquery_en_5.4.2_3.0_1724602921121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_osquery_en_5.4.2_3.0_1724602921121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_osquery","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_osquery", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_osquery| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/Osquery/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_pipeline_en.md new file mode 100644 index 00000000000000..b3b05c8dcf4d9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_osquery_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_osquery_pipeline pipeline T5Transformer from Osquery +author: John Snow Labs +name: burmese_awesome_opus_books_model_osquery_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_osquery_pipeline` is a English model originally trained by Osquery. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_osquery_pipeline_en_5.4.2_3.0_1724602940032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_osquery_pipeline_en_5.4.2_3.0_1724602940032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_osquery_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_osquery_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_osquery_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/Osquery/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_en.md new file mode 100644 index 00000000000000..dae86169be17a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_prabhas2002 T5Transformer from Prabhas2002 +author: John Snow Labs +name: burmese_awesome_opus_books_model_prabhas2002 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_prabhas2002` is a English model originally trained by Prabhas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_prabhas2002_en_5.4.2_3.0_1724619914006.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_prabhas2002_en_5.4.2_3.0_1724619914006.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_prabhas2002","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_prabhas2002", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_prabhas2002| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/Prabhas2002/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_pipeline_en.md new file mode 100644 index 00000000000000..6c605cce1cf351 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_prabhas2002_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_prabhas2002_pipeline pipeline T5Transformer from Prabhas2002 +author: John Snow Labs +name: burmese_awesome_opus_books_model_prabhas2002_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_prabhas2002_pipeline` is a English model originally trained by Prabhas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_prabhas2002_pipeline_en_5.4.2_3.0_1724619933186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_prabhas2002_pipeline_en_5.4.2_3.0_1724619933186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_prabhas2002_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_prabhas2002_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_prabhas2002_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/Prabhas2002/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_en.md new file mode 100644 index 00000000000000..0535061c9353ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rabby33 T5Transformer from rabby33 +author: John Snow Labs +name: burmese_awesome_opus_books_model_rabby33 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rabby33` is a English model originally trained by rabby33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rabby33_en_5.4.2_3.0_1724599872675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rabby33_en_5.4.2_3.0_1724599872675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rabby33","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rabby33", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rabby33| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.3 MB| + +## References + +https://huggingface.co/rabby33/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_pipeline_en.md new file mode 100644 index 00000000000000..59f6e57d2c75fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rabby33_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rabby33_pipeline pipeline T5Transformer from rabby33 +author: John Snow Labs +name: burmese_awesome_opus_books_model_rabby33_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rabby33_pipeline` is a English model originally trained by rabby33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rabby33_pipeline_en_5.4.2_3.0_1724599901403.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rabby33_pipeline_en_5.4.2_3.0_1724599901403.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_rabby33_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_rabby33_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rabby33_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.3 MB| + +## References + +https://huggingface.co/rabby33/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_en.md new file mode 100644 index 00000000000000..061c2364df02ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rujengelal T5Transformer from rujengelal +author: John Snow Labs +name: burmese_awesome_opus_books_model_rujengelal +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rujengelal` is a English model originally trained by rujengelal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rujengelal_en_5.4.2_3.0_1724605344777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rujengelal_en_5.4.2_3.0_1724605344777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rujengelal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rujengelal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rujengelal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.3 MB| + +## References + +https://huggingface.co/rujengelal/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_pipeline_en.md new file mode 100644 index 00000000000000..d89d794b8d6997 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_rujengelal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rujengelal_pipeline pipeline T5Transformer from rujengelal +author: John Snow Labs +name: burmese_awesome_opus_books_model_rujengelal_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rujengelal_pipeline` is a English model originally trained by rujengelal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rujengelal_pipeline_en_5.4.2_3.0_1724605364194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rujengelal_pipeline_en_5.4.2_3.0_1724605364194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_rujengelal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_rujengelal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rujengelal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.3 MB| + +## References + +https://huggingface.co/rujengelal/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_en.md new file mode 100644 index 00000000000000..8b2a12308b155e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_sofa566 T5Transformer from sofa566 +author: John Snow Labs +name: burmese_awesome_opus_books_model_sofa566 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_sofa566` is a English model originally trained by sofa566. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_sofa566_en_5.4.2_3.0_1724555869754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_sofa566_en_5.4.2_3.0_1724555869754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_sofa566","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_sofa566", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_sofa566| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/sofa566/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_pipeline_en.md new file mode 100644 index 00000000000000..7ca015882a610b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_awesome_opus_books_model_sofa566_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_sofa566_pipeline pipeline T5Transformer from sofa566 +author: John Snow Labs +name: burmese_awesome_opus_books_model_sofa566_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_sofa566_pipeline` is a English model originally trained by sofa566. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_sofa566_pipeline_en_5.4.2_3.0_1724555886897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_sofa566_pipeline_en_5.4.2_3.0_1724555886897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_sofa566_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_sofa566_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_sofa566_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/sofa566/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_en.md new file mode 100644 index 00000000000000..0a2fcb1819c7c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_translator T5Transformer from jsphelps12 +author: John Snow Labs +name: burmese_translator +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_translator` is a English model originally trained by jsphelps12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_translator_en_5.4.2_3.0_1724624595898.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_translator_en_5.4.2_3.0_1724624595898.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_translator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_translator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_translator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jsphelps12/my_translator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_pipeline_en.md new file mode 100644 index 00000000000000..14360d9e4328e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-burmese_translator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_translator_pipeline pipeline T5Transformer from jsphelps12 +author: John Snow Labs +name: burmese_translator_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_translator_pipeline` is a English model originally trained by jsphelps12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_translator_pipeline_en_5.4.2_3.0_1724624612759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_translator_pipeline_en_5.4.2_3.0_1724624612759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_translator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_translator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_translator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jsphelps12/my_translator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-catessum_4_en.md b/docs/_posts/ahmedlone127/2024-08-25-catessum_4_en.md new file mode 100644 index 00000000000000..710273cfc4925a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-catessum_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English catessum_4 T5Transformer from homersimpson +author: John Snow Labs +name: catessum_4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catessum_4` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catessum_4_en_5.4.2_3.0_1724599699848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catessum_4_en_5.4.2_3.0_1724599699848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("catessum_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("catessum_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catessum_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/homersimpson/catessum-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-catessum_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-catessum_4_pipeline_en.md new file mode 100644 index 00000000000000..e7a04315a1ae72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-catessum_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English catessum_4_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: catessum_4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catessum_4_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catessum_4_pipeline_en_5.4.2_3.0_1724599748936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catessum_4_pipeline_en_5.4.2_3.0_1724599748936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("catessum_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("catessum_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catessum_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/homersimpson/catessum-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_en.md b/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_en.md new file mode 100644 index 00000000000000..7b516fad914826 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English clickbait_spoiling_passage T5Transformer from Tugay +author: John Snow Labs +name: clickbait_spoiling_passage +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clickbait_spoiling_passage` is a English model originally trained by Tugay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_passage_en_5.4.2_3.0_1724562778957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_passage_en_5.4.2_3.0_1724562778957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("clickbait_spoiling_passage","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("clickbait_spoiling_passage", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clickbait_spoiling_passage| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Tugay/clickbait_spoiling_passage \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_pipeline_en.md new file mode 100644 index 00000000000000..162e6b8028f85b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-clickbait_spoiling_passage_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English clickbait_spoiling_passage_pipeline pipeline T5Transformer from Tugay +author: John Snow Labs +name: clickbait_spoiling_passage_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clickbait_spoiling_passage_pipeline` is a English model originally trained by Tugay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_passage_pipeline_en_5.4.2_3.0_1724562926515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_passage_pipeline_en_5.4.2_3.0_1724562926515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("clickbait_spoiling_passage_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("clickbait_spoiling_passage_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clickbait_spoiling_passage_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Tugay/clickbait_spoiling_passage + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_en.md new file mode 100644 index 00000000000000..1d34fbf2b90b3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_aligned_smallt5_full T5Transformer from paulh27 +author: John Snow Labs +name: cnn_aligned_smallt5_full +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_aligned_smallt5_full` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_full_en_5.4.2_3.0_1724619959799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_full_en_5.4.2_3.0_1724619959799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_aligned_smallt5_full","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_aligned_smallt5_full", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_aligned_smallt5_full| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/cnn_aligned_smallT5_full \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_pipeline_en.md new file mode 100644 index 00000000000000..039b72601bae4d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_aligned_smallt5_full_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_aligned_smallt5_full_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: cnn_aligned_smallt5_full_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_aligned_smallt5_full_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_full_pipeline_en_5.4.2_3.0_1724619976440.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_full_pipeline_en_5.4.2_3.0_1724619976440.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_aligned_smallt5_full_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_aligned_smallt5_full_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_aligned_smallt5_full_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/cnn_aligned_smallT5_full + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_en.md new file mode 100644 index 00000000000000..44ec73ba797936 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5 T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_en_5.4.2_3.0_1724556659495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_en_5.4.2_3.0_1724556659495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_4_50000_6_e-1_s6789_v4_l5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline_en.md new file mode 100644 index 00000000000000..9c94239589a91a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline pipeline T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline_en_5.4.2_3.0_1724556678724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline_en_5.4.2_3.0_1724556678724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_4_50000_6_e_1_s6789_v4_l5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_4_50000_6_e-1_s6789_v4_l5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_en.md new file mode 100644 index 00000000000000..48c33f28d9bbff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_summarization_deepaktripathy1 T5Transformer from deepaktripathy1 +author: John Snow Labs +name: cnn_summarization_deepaktripathy1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_summarization_deepaktripathy1` is a English model originally trained by deepaktripathy1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_summarization_deepaktripathy1_en_5.4.2_3.0_1724617203497.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_summarization_deepaktripathy1_en_5.4.2_3.0_1724617203497.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_summarization_deepaktripathy1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_summarization_deepaktripathy1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_summarization_deepaktripathy1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.7 MB| + +## References + +https://huggingface.co/deepaktripathy1/cnn_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_pipeline_en.md new file mode 100644 index 00000000000000..e5f531469e5f69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cnn_summarization_deepaktripathy1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_summarization_deepaktripathy1_pipeline pipeline T5Transformer from deepaktripathy1 +author: John Snow Labs +name: cnn_summarization_deepaktripathy1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_summarization_deepaktripathy1_pipeline` is a English model originally trained by deepaktripathy1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_summarization_deepaktripathy1_pipeline_en_5.4.2_3.0_1724617223379.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_summarization_deepaktripathy1_pipeline_en_5.4.2_3.0_1724617223379.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_summarization_deepaktripathy1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_summarization_deepaktripathy1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_summarization_deepaktripathy1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.7 MB| + +## References + +https://huggingface.co/deepaktripathy1/cnn_summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_en.md b/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_en.md new file mode 100644 index 00000000000000..d95734bc2271c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cptkginfusedlmaviationkgverbtanu20 T5Transformer from sakharamg +author: John Snow Labs +name: cptkginfusedlmaviationkgverbtanu20 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptkginfusedlmaviationkgverbtanu20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptkginfusedlmaviationkgverbtanu20_en_5.4.2_3.0_1724576518376.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptkginfusedlmaviationkgverbtanu20_en_5.4.2_3.0_1724576518376.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cptkginfusedlmaviationkgverbtanu20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cptkginfusedlmaviationkgverbtanu20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptkginfusedlmaviationkgverbtanu20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTKGinfusedLMAviationKGverbtanu20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_pipeline_en.md new file mode 100644 index 00000000000000..7916ed428a1852 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cptkginfusedlmaviationkgverbtanu20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cptkginfusedlmaviationkgverbtanu20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cptkginfusedlmaviationkgverbtanu20_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptkginfusedlmaviationkgverbtanu20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptkginfusedlmaviationkgverbtanu20_pipeline_en_5.4.2_3.0_1724576656837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptkginfusedlmaviationkgverbtanu20_pipeline_en_5.4.2_3.0_1724576656837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cptkginfusedlmaviationkgverbtanu20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cptkginfusedlmaviationkgverbtanu20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptkginfusedlmaviationkgverbtanu20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTKGinfusedLMAviationKGverbtanu20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_en.md b/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_en.md new file mode 100644 index 00000000000000..6940d9bff0c169 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cptt5largewithaviationcorpus20 T5Transformer from sakharamg +author: John Snow Labs +name: cptt5largewithaviationcorpus20 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptt5largewithaviationcorpus20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpus20_en_5.4.2_3.0_1724617207945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpus20_en_5.4.2_3.0_1724617207945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cptt5largewithaviationcorpus20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cptt5largewithaviationcorpus20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptt5largewithaviationcorpus20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTT5largewithaviationcorpus20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_pipeline_en.md new file mode 100644 index 00000000000000..83bbc89ae6c832 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cptt5largewithaviationcorpus20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cptt5largewithaviationcorpus20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cptt5largewithaviationcorpus20_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptt5largewithaviationcorpus20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpus20_pipeline_en_5.4.2_3.0_1724617355231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptt5largewithaviationcorpus20_pipeline_en_5.4.2_3.0_1724617355231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cptt5largewithaviationcorpus20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cptt5largewithaviationcorpus20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptt5largewithaviationcorpus20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTT5largewithaviationcorpus20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting11_aspol_vcheck_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting11_aspol_vcheck_en.md new file mode 100644 index 00000000000000..edf83db904dbee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting11_aspol_vcheck_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting11_aspol_vcheck T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting11_aspol_vcheck +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting11_aspol_vcheck` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting11_aspol_vcheck_en_5.4.2_3.0_1724571781068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting11_aspol_vcheck_en_5.4.2_3.0_1724571781068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting11_aspol_vcheck","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting11_aspol_vcheck", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting11_aspol_vcheck| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting11_ASPOL_vcheck \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_en.md new file mode 100644 index 00000000000000..b2f0b11e0668d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting15_aspol_vcheck T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting15_aspol_vcheck +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting15_aspol_vcheck` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting15_aspol_vcheck_en_5.4.2_3.0_1724580550885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting15_aspol_vcheck_en_5.4.2_3.0_1724580550885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting15_aspol_vcheck","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting15_aspol_vcheck", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting15_aspol_vcheck| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting15_ASPOL_vcheck \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline_en.md new file mode 100644 index 00000000000000..51d075a1c1eda5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline_en_5.4.2_3.0_1724580720311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline_en_5.4.2_3.0_1724580720311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting15_aspol_vcheck_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting15_ASPOL_vcheck + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_en.md new file mode 100644 index 00000000000000..75ee65139c13db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_eql_aug2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_eql_aug2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_eql_aug2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_eql_aug2_en_5.4.2_3.0_1724549866207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_eql_aug2_en_5.4.2_3.0_1724549866207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_eql_aug2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_eql_aug2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_eql_aug2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_EQL_Aug2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline_en.md new file mode 100644 index 00000000000000..a6582f5faf2f67 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline_en_5.4.2_3.0_1724550034857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline_en_5.4.2_3.0_1724550034857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_eql_aug2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_EQL_Aug2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_en.md new file mode 100644 index 00000000000000..9211e80027368a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_en_5.4.2_3.0_1724600453948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_en_5.4.2_3.0_1724600453948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_T3vsLabel2T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline_en.md new file mode 100644 index 00000000000000..2875c572bc1320 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline_en_5.4.2_3.0_1724600625800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline_en_5.4.2_3.0_1724600625800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_T3vsLabel2T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_en.md new file mode 100644 index 00000000000000..c3ad8fe61782d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aspol_check_stable2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aspol_check_stable2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aspol_check_stable2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_check_stable2_en_5.4.2_3.0_1724555083966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_check_stable2_en_5.4.2_3.0_1724555083966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aspol_check_stable2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aspol_check_stable2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aspol_check_stable2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASPOL_check_stable2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline_en.md new file mode 100644 index 00000000000000..cf3125eac198ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline_en_5.4.2_3.0_1724555255394.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline_en_5.4.2_3.0_1724555255394.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aspol_check_stable2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASPOL_check_stable2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_en.md new file mode 100644 index 00000000000000..b0b665ff78625b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aspol_vtune_3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aspol_vtune_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aspol_vtune_3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_vtune_3_en_5.4.2_3.0_1724592661145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_vtune_3_en_5.4.2_3.0_1724592661145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aspol_vtune_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aspol_vtune_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aspol_vtune_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASPOL_vtune_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline_en.md new file mode 100644 index 00000000000000..3067a0c25647f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline_en_5.4.2_3.0_1724592856819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline_en_5.4.2_3.0_1724592856819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aspol_vtune_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_ASPOL_vtune_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_en.md new file mode 100644 index 00000000000000..ca90e97e3989fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_posal T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_posal +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_posal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_posal_en_5.4.2_3.0_1724574459087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_posal_en_5.4.2_3.0_1724574459087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_posal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_posal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_posal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_POSAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_pipeline_en.md new file mode 100644 index 00000000000000..4ea8e989e0773b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_prompting5_posal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_posal_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_posal_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_posal_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_posal_pipeline_en_5.4.2_3.0_1724574641552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_posal_pipeline_en_5.4.2_3.0_1724574641552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_posal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_posal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_posal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_POSAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_en.md new file mode 100644 index 00000000000000..6c2a7efd81bafe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_aspol_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_aspol_v1_h1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_aspol_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aspol_v1_h1_en_5.4.2_3.0_1724573338875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aspol_v1_h1_en_5.4.2_3.0_1724573338875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_aspol_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_aspol_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_aspol_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_ASPOL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..1f1adc597208f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline_en_5.4.2_3.0_1724573516914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline_en_5.4.2_3.0_1724573516914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_aspol_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_ASPOL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_en.md new file mode 100644 index 00000000000000..17d78ff644e2cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_opsal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_opsal_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_opsal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_opsal_v1_en_5.4.2_3.0_1724561402695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_opsal_v1_en_5.4.2_3.0_1724561402695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_opsal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_opsal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_opsal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_OPSAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline_en.md new file mode 100644 index 00000000000000..761387060c4a5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline_en_5.4.2_3.0_1724561572806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline_en_5.4.2_3.0_1724561572806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_opsal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_OPSAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_en.md new file mode 100644 index 00000000000000..85550f079b97fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_h3 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_h3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_h3` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h3_en_5.4.2_3.0_1724624566263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h3_en_5.4.2_3.0_1724624566263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_h3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_h3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_h3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_h3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline_en.md new file mode 100644 index 00000000000000..caf6a9f6da35ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline_en_5.4.2_3.0_1724624750661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline_en_5.4.2_3.0_1724624750661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_h3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_h3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_en.md new file mode 100644 index 00000000000000..bf60c419526b4a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oapsl T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oapsl +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oapsl` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oapsl_en_5.4.2_3.0_1724586200487.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oapsl_en_5.4.2_3.0_1724586200487.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oapsl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oapsl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oapsl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OAPSL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_pipeline_en.md new file mode 100644 index 00000000000000..6c21f12a9d87c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_oapsl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oapsl_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oapsl_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oapsl_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oapsl_pipeline_en_5.4.2_3.0_1724586370889.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oapsl_pipeline_en_5.4.2_3.0_1724586370889.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oapsl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oapsl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oapsl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OAPSL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_en.md new file mode 100644 index 00000000000000..43573930880218 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_opasl T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_opasl +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_opasl` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opasl_en_5.4.2_3.0_1724581980431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opasl_en_5.4.2_3.0_1724581980431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_opasl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_opasl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_opasl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OPASL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_pipeline_en.md new file mode 100644 index 00000000000000..7e446940c7d9ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_opasl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_opasl_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_opasl_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_opasl_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opasl_pipeline_en_5.4.2_3.0_1724582160221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opasl_pipeline_en_5.4.2_3.0_1724582160221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_opasl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_opasl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_opasl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OPASL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_en.md new file mode 100644 index 00000000000000..e2ab1a10227f30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_poasl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_poasl_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_poasl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_poasl_v1_en_5.4.2_3.0_1724569016026.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_poasl_v1_en_5.4.2_3.0_1724569016026.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_poasl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_poasl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_poasl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_POASL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline_en.md new file mode 100644 index 00000000000000..7f1fc6b62f4dc6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline_en_5.4.2_3.0_1724569191320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline_en_5.4.2_3.0_1724569191320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_poasl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_POASL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_en.md new file mode 100644 index 00000000000000..6468d09d6c2cde --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_sapol_v2 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_sapol_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_sapol_v2` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_sapol_v2_en_5.4.2_3.0_1724614697570.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_sapol_v2_en_5.4.2_3.0_1724614697570.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_sapol_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_sapol_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_sapol_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAPOL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline_en.md new file mode 100644 index 00000000000000..6d988b194d7d53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline_en_5.4.2_3.0_1724614881234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline_en_5.4.2_3.0_1724614881234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_sapol_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAPOL_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_en.md new file mode 100644 index 00000000000000..60cd69dc3cc73a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_pasol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_pasol_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_pasol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_pasol_v1_en_5.4.2_3.0_1724565451926.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_pasol_v1_en_5.4.2_3.0_1724565451926.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_pasol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_pasol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_pasol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_PASOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline_en.md new file mode 100644 index 00000000000000..6fadd646fe065c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline_en_5.4.2_3.0_1724565618462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline_en_5.4.2_3.0_1724565618462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_pasol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_PASOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction5_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction5_soapl_v1_en.md new file mode 100644 index 00000000000000..6f5a4989449345 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instruction5_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction5_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction5_soapl_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction5_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction5_soapl_v1_en_5.4.2_3.0_1724595354812.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction5_soapl_v1_en_5.4.2_3.0_1724595354812.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction5_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction5_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction5_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction5_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_en.md new file mode 100644 index 00000000000000..adb59d8fd90534 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_oaspl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_oaspl_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_oaspl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_oaspl_v1_en_5.4.2_3.0_1724621591336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_oaspl_v1_en_5.4.2_3.0_1724621591336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_oaspl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_oaspl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_oaspl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OASPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline_en.md new file mode 100644 index 00000000000000..7ef202176413e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline_en_5.4.2_3.0_1724621765215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline_en_5.4.2_3.0_1724621765215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_oaspl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OASPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_en.md new file mode 100644 index 00000000000000..375d59dbbc33fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_osapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_osapl_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_osapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_osapl_v1_en_5.4.2_3.0_1724606698550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_osapl_v1_en_5.4.2_3.0_1724606698550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_osapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_osapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_osapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OSAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..806d100495f9a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline_en_5.4.2_3.0_1724606895616.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline_en_5.4.2_3.0_1724606895616.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_osapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OSAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_en.md new file mode 100644 index 00000000000000..788ea7bf566b8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_spoal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_spoal_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_spoal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_spoal_v1_en_5.4.2_3.0_1724605411146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_spoal_v1_en_5.4.2_3.0_1724605411146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_spoal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_spoal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_spoal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_SPOAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline_en.md new file mode 100644 index 00000000000000..8e1dfc2d30f565 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline_en_5.4.2_3.0_1724605586009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline_en_5.4.2_3.0_1724605586009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_spoal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_SPOAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_en.md new file mode 100644 index 00000000000000..29e06e97440806 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn2_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn2_soapl_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn2_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn2_soapl_v1_en_5.4.2_3.0_1724591220783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn2_soapl_v1_en_5.4.2_3.0_1724591220783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn2_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn2_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn2_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN2_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..977826be1cd133 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline_en_5.4.2_3.0_1724591393472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline_en_5.4.2_3.0_1724591393472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn2_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN2_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_en.md b/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_en.md new file mode 100644 index 00000000000000..df991911749933 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cti_t5_ner_cti T5Transformer from mrmoor +author: John Snow Labs +name: cti_t5_ner_cti +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cti_t5_ner_cti` is a English model originally trained by mrmoor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cti_t5_ner_cti_en_5.4.2_3.0_1724613672859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cti_t5_ner_cti_en_5.4.2_3.0_1724613672859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cti_t5_ner_cti","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cti_t5_ner_cti", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cti_t5_ner_cti| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mrmoor/cti-t5-NER-CTI \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_pipeline_en.md new file mode 100644 index 00000000000000..4473a555e74ed9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-cti_t5_ner_cti_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cti_t5_ner_cti_pipeline pipeline T5Transformer from mrmoor +author: John Snow Labs +name: cti_t5_ner_cti_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cti_t5_ner_cti_pipeline` is a English model originally trained by mrmoor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cti_t5_ner_cti_pipeline_en_5.4.2_3.0_1724613724434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cti_t5_ner_cti_pipeline_en_5.4.2_3.0_1724613724434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cti_t5_ner_cti_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cti_t5_ner_cti_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cti_t5_ner_cti_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mrmoor/cti-t5-NER-CTI + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_en.md b/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_en.md new file mode 100644 index 00000000000000..3822de3fc3a573 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English custom_t5_robot_model T5Transformer from RDaneelOlivaw +author: John Snow Labs +name: custom_t5_robot_model +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`custom_t5_robot_model` is a English model originally trained by RDaneelOlivaw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/custom_t5_robot_model_en_5.4.2_3.0_1724606260953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/custom_t5_robot_model_en_5.4.2_3.0_1724606260953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("custom_t5_robot_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("custom_t5_robot_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|custom_t5_robot_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/RDaneelOlivaw/custom_t5_robot_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_pipeline_en.md new file mode 100644 index 00000000000000..d7eac3ed5f29da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-custom_t5_robot_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English custom_t5_robot_model_pipeline pipeline T5Transformer from RDaneelOlivaw +author: John Snow Labs +name: custom_t5_robot_model_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`custom_t5_robot_model_pipeline` is a English model originally trained by RDaneelOlivaw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/custom_t5_robot_model_pipeline_en_5.4.2_3.0_1724606279673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/custom_t5_robot_model_pipeline_en_5.4.2_3.0_1724606279673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("custom_t5_robot_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("custom_t5_robot_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|custom_t5_robot_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/RDaneelOlivaw/custom_t5_robot_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_en.md b/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_en.md new file mode 100644 index 00000000000000..9f3f63b4ab3060 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English datapars_base_202 T5Transformer from uaritm +author: John Snow Labs +name: datapars_base_202 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`datapars_base_202` is a English model originally trained by uaritm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/datapars_base_202_en_5.4.2_3.0_1724584380605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/datapars_base_202_en_5.4.2_3.0_1724584380605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("datapars_base_202","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("datapars_base_202", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|datapars_base_202| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.0 MB| + +## References + +https://huggingface.co/uaritm/datapars-base-202 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_pipeline_en.md new file mode 100644 index 00000000000000..4c1fc6f4256cb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-datapars_base_202_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English datapars_base_202_pipeline pipeline T5Transformer from uaritm +author: John Snow Labs +name: datapars_base_202_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`datapars_base_202_pipeline` is a English model originally trained by uaritm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/datapars_base_202_pipeline_en_5.4.2_3.0_1724584428273.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/datapars_base_202_pipeline_en_5.4.2_3.0_1724584428273.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("datapars_base_202_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("datapars_base_202_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|datapars_base_202_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.0 MB| + +## References + +https://huggingface.co/uaritm/datapars-base-202 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_en.md b/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_en.md new file mode 100644 index 00000000000000..dd86a38c088091 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dataset_radiology_20220912_tsv T5Transformer from hisaoka +author: John Snow Labs +name: dataset_radiology_20220912_tsv +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dataset_radiology_20220912_tsv` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dataset_radiology_20220912_tsv_en_5.4.2_3.0_1724557277900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dataset_radiology_20220912_tsv_en_5.4.2_3.0_1724557277900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dataset_radiology_20220912_tsv","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dataset_radiology_20220912_tsv", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dataset_radiology_20220912_tsv| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/dataset_radiology_20220912.tsv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_pipeline_en.md new file mode 100644 index 00000000000000..a6510a767df17c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-dataset_radiology_20220912_tsv_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dataset_radiology_20220912_tsv_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: dataset_radiology_20220912_tsv_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dataset_radiology_20220912_tsv_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dataset_radiology_20220912_tsv_pipeline_en_5.4.2_3.0_1724557442461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dataset_radiology_20220912_tsv_pipeline_en_5.4.2_3.0_1724557442461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dataset_radiology_20220912_tsv_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dataset_radiology_20220912_tsv_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dataset_radiology_20220912_tsv_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/dataset_radiology_20220912.tsv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-description_test_en.md b/docs/_posts/ahmedlone127/2024-08-25-description_test_en.md new file mode 100644 index 00000000000000..407e44e10a9cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-description_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English description_test T5Transformer from lucasnobre212 +author: John Snow Labs +name: description_test +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`description_test` is a English model originally trained by lucasnobre212. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/description_test_en_5.4.2_3.0_1724564333900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/description_test_en_5.4.2_3.0_1724564333900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("description_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("description_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|description_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/lucasnobre212/description-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-description_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-description_test_pipeline_en.md new file mode 100644 index 00000000000000..9b8520d26e8d75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-description_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English description_test_pipeline pipeline T5Transformer from lucasnobre212 +author: John Snow Labs +name: description_test_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`description_test_pipeline` is a English model originally trained by lucasnobre212. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/description_test_pipeline_en_5.4.2_3.0_1724564363728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/description_test_pipeline_en_5.4.2_3.0_1724564363728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("description_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("description_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|description_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/lucasnobre212/description-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_en.md new file mode 100644 index 00000000000000..64fc9d995475f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099_0_2 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_0_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_0_2` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_2_en_5.4.2_3.0_1724585050944.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_2_en_5.4.2_3.0_1724585050944.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099_0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099_0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_pipeline_en.md new file mode 100644 index 00000000000000..d0ebb59fef795b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_0_2_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_0_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_0_2_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_2_pipeline_en_5.4.2_3.0_1724585240048.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_0_2_pipeline_en_5.4.2_3.0_1724585240048.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_en.md new file mode 100644 index 00000000000000..8872ac0d8fa5b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099_10 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_10 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_10` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_10_en_5.4.2_3.0_1724584376945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_10_en_5.4.2_3.0_1724584376945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_pipeline_en.md new file mode 100644 index 00000000000000..6643c6dc7d1baf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_010099_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_10_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_10_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_10_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_10_pipeline_en_5.4.2_3.0_1724584558340.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_10_pipeline_en_5.4.2_3.0_1724584558340.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_en.md new file mode 100644 index 00000000000000..a5ecd0dac7f832 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_1_en_5.4.2_3.0_1724584860191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_1_en_5.4.2_3.0_1724584860191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_pipeline_en.md new file mode 100644 index 00000000000000..b5b945c6e0fde1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_02_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_1_pipeline_en_5.4.2_3.0_1724585047561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_1_pipeline_en_5.4.2_3.0_1724585047561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_02_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_02_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_en.md new file mode 100644 index 00000000000000..0a0bd448a182ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_4_0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_4_0_5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_4_0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_4_0_5_en_5.4.2_3.0_1724547243868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_4_0_5_en_5.4.2_3.0_1724547243868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_4_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_4_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_4_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.4-0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_pipeline_en.md new file mode 100644 index 00000000000000..6ec636e7722c8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_4_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_4_0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_4_0_5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_4_0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_4_0_5_pipeline_en_5.4.2_3.0_1724547429340.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_4_0_5_pipeline_en_5.4.2_3.0_1724547429340.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_4_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_4_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_4_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.4-0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_en.md new file mode 100644 index 00000000000000..3b9039138ea5af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_0_25 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_0_25_en_5.4.2_3.0_1724596432147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_0_25_en_5.4.2_3.0_1724596432147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_pipeline_en.md new file mode 100644 index 00000000000000..43be4552483c66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilled_mt5_small_0_8_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_0_25_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_0_25_pipeline_en_5.4.2_3.0_1724596624193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_0_25_pipeline_en_5.4.2_3.0_1724596624193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_8_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_8_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_en.md new file mode 100644 index 00000000000000..d572a5182a45d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilt5_coqa T5Transformer from rooftopcoder +author: John Snow Labs +name: distilt5_coqa +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilt5_coqa` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilt5_coqa_en_5.4.2_3.0_1724545229032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilt5_coqa_en_5.4.2_3.0_1724545229032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilt5_coqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilt5_coqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilt5_coqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.2 MB| + +## References + +https://huggingface.co/rooftopcoder/distilt5-coqa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_pipeline_en.md new file mode 100644 index 00000000000000..b21f847e091158 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-distilt5_coqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilt5_coqa_pipeline pipeline T5Transformer from rooftopcoder +author: John Snow Labs +name: distilt5_coqa_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilt5_coqa_pipeline` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilt5_coqa_pipeline_en_5.4.2_3.0_1724545244471.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilt5_coqa_pipeline_en_5.4.2_3.0_1724545244471.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilt5_coqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilt5_coqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilt5_coqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.2 MB| + +## References + +https://huggingface.co/rooftopcoder/distilt5-coqa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_en.md b/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_en.md new file mode 100644 index 00000000000000..21981cda3524af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English doc2query_t5_base_msmarco_10000 T5Transformer from yashonwu +author: John Snow Labs +name: doc2query_t5_base_msmarco_10000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_t5_base_msmarco_10000` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_t5_base_msmarco_10000_en_5.4.2_3.0_1724619811284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_t5_base_msmarco_10000_en_5.4.2_3.0_1724619811284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("doc2query_t5_base_msmarco_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("doc2query_t5_base_msmarco_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_t5_base_msmarco_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|966.9 MB| + +## References + +https://huggingface.co/yashonwu/doc2query-t5-base-msmarco-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_pipeline_en.md new file mode 100644 index 00000000000000..a68029fc8fb373 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-doc2query_t5_base_msmarco_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English doc2query_t5_base_msmarco_10000_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: doc2query_t5_base_msmarco_10000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_t5_base_msmarco_10000_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_t5_base_msmarco_10000_pipeline_en_5.4.2_3.0_1724619871799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_t5_base_msmarco_10000_pipeline_en_5.4.2_3.0_1724619871799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("doc2query_t5_base_msmarco_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("doc2query_t5_base_msmarco_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_t5_base_msmarco_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|966.9 MB| + +## References + +https://huggingface.co/yashonwu/doc2query-t5-base-msmarco-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-drone_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-drone_1_en.md new file mode 100644 index 00000000000000..ae08fbc119717c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-drone_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English drone_1 T5Transformer from sahithya20 +author: John Snow Labs +name: drone_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`drone_1` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/drone_1_en_5.4.2_3.0_1724619168161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/drone_1_en_5.4.2_3.0_1724619168161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("drone_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("drone_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|drone_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|263.7 MB| + +## References + +https://huggingface.co/sahithya20/drone_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-drone_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-drone_1_pipeline_en.md new file mode 100644 index 00000000000000..9d809f9cb602de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-drone_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English drone_1_pipeline pipeline T5Transformer from sahithya20 +author: John Snow Labs +name: drone_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`drone_1_pipeline` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/drone_1_pipeline_en_5.4.2_3.0_1724619196993.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/drone_1_pipeline_en_5.4.2_3.0_1724619196993.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("drone_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("drone_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|drone_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|263.7 MB| + +## References + +https://huggingface.co/sahithya20/drone_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_en.md new file mode 100644 index 00000000000000..aa44c04b69b062 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ds_chatbot_vit5_base T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_base` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_base_en_5.4.2_3.0_1724564259636.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_base_en_5.4.2_3.0_1724564259636.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ds_chatbot_vit5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ds_chatbot_vit5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_pipeline_en.md new file mode 100644 index 00000000000000..a38f5b6ec2d31f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ds_chatbot_vit5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ds_chatbot_vit5_base_pipeline pipeline T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_base_pipeline` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_base_pipeline_en_5.4.2_3.0_1724564312596.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_base_pipeline_en_5.4.2_3.0_1724564312596.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ds_chatbot_vit5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ds_chatbot_vit5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_en.md new file mode 100644 index 00000000000000..1f2b903395f04d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ea_24_2 T5Transformer from butterflytech +author: John Snow Labs +name: ea_24_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ea_24_2` is a English model originally trained by butterflytech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ea_24_2_en_5.4.2_3.0_1724558230263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ea_24_2_en_5.4.2_3.0_1724558230263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ea_24_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ea_24_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ea_24_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.0 MB| + +## References + +https://huggingface.co/butterflytech/ea-24-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_pipeline_en.md new file mode 100644 index 00000000000000..513108e102dcbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ea_24_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ea_24_2_pipeline pipeline T5Transformer from butterflytech +author: John Snow Labs +name: ea_24_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ea_24_2_pipeline` is a English model originally trained by butterflytech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ea_24_2_pipeline_en_5.4.2_3.0_1724558280653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ea_24_2_pipeline_en_5.4.2_3.0_1724558280653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ea_24_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ea_24_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ea_24_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.0 MB| + +## References + +https://huggingface.co/butterflytech/ea-24-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_en.md b/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_en.md new file mode 100644 index 00000000000000..2d152dcd742a10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english2nepalitranslate T5Transformer from Hemg +author: John Snow Labs +name: english2nepalitranslate +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english2nepalitranslate` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english2nepalitranslate_en_5.4.2_3.0_1724584234482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english2nepalitranslate_en_5.4.2_3.0_1724584234482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english2nepalitranslate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english2nepalitranslate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english2nepalitranslate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.5 MB| + +## References + +https://huggingface.co/Hemg/english2nepalitranslate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_pipeline_en.md new file mode 100644 index 00000000000000..cbd3e66e3eddcc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-english2nepalitranslate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english2nepalitranslate_pipeline pipeline T5Transformer from Hemg +author: John Snow Labs +name: english2nepalitranslate_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english2nepalitranslate_pipeline` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english2nepalitranslate_pipeline_en_5.4.2_3.0_1724584251856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english2nepalitranslate_pipeline_en_5.4.2_3.0_1724584251856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english2nepalitranslate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english2nepalitranslate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english2nepalitranslate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.5 MB| + +## References + +https://huggingface.co/Hemg/english2nepalitranslate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_en.md b/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_en.md new file mode 100644 index 00000000000000..c19171a218ddf9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_vietnamese_vietai T5Transformer from hungphongtrn +author: John Snow Labs +name: english_vietnamese_vietai +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_vietnamese_vietai` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_vietnamese_vietai_en_5.4.2_3.0_1724560613525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_vietnamese_vietai_en_5.4.2_3.0_1724560613525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_vietnamese_vietai","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_vietnamese_vietai", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_vietnamese_vietai| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/en_vi_vietai \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_pipeline_en.md new file mode 100644 index 00000000000000..99718e20af9d02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-english_vietnamese_vietai_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_vietnamese_vietai_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: english_vietnamese_vietai_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_vietnamese_vietai_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_vietnamese_vietai_pipeline_en_5.4.2_3.0_1724560683056.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_vietnamese_vietai_pipeline_en_5.4.2_3.0_1724560683056.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_vietnamese_vietai_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_vietnamese_vietai_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_vietnamese_vietai_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/en_vi_vietai + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_en.md b/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_en.md new file mode 100644 index 00000000000000..00871f3d688d97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fake_news_gen T5Transformer from Ahmedhany216 +author: John Snow Labs +name: fake_news_gen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fake_news_gen` is a English model originally trained by Ahmedhany216. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fake_news_gen_en_5.4.2_3.0_1724592696427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fake_news_gen_en_5.4.2_3.0_1724592696427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fake_news_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fake_news_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fake_news_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ahmedhany216/Fake-news-gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_pipeline_en.md new file mode 100644 index 00000000000000..1a473c2cf0d888 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fake_news_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fake_news_gen_pipeline pipeline T5Transformer from Ahmedhany216 +author: John Snow Labs +name: fake_news_gen_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fake_news_gen_pipeline` is a English model originally trained by Ahmedhany216. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fake_news_gen_pipeline_en_5.4.2_3.0_1724592744833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fake_news_gen_pipeline_en_5.4.2_3.0_1724592744833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fake_news_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fake_news_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fake_news_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ahmedhany216/Fake-news-gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1_en.md new file mode 100644 index 00000000000000..ed1c086210d213 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1 T5Transformer from tau +author: John Snow Labs +name: false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1` is a English model originally trained by tau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1_en_5.4.2_3.0_1724569250364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1_en_5.4.2_3.0_1724569250364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|false_large_random_para0_sent1_span2_itfalse_sargmax_rrfalse_8_1024_0_15_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/tau/False_large_random_para0_sent1_span2_itFalse_sargmax_rrFalse_8_1024_0.15_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_en.md new file mode 100644 index 00000000000000..69a3e2a75e6c3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English filtered_annotated100k_mt5 T5Transformer from fia24 +author: John Snow Labs +name: filtered_annotated100k_mt5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`filtered_annotated100k_mt5` is a English model originally trained by fia24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/filtered_annotated100k_mt5_en_5.4.2_3.0_1724621104926.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/filtered_annotated100k_mt5_en_5.4.2_3.0_1724621104926.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("filtered_annotated100k_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("filtered_annotated100k_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|filtered_annotated100k_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/fia24/filtered_annotated100k_mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_pipeline_en.md new file mode 100644 index 00000000000000..ca26002f6d38c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-filtered_annotated100k_mt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English filtered_annotated100k_mt5_pipeline pipeline T5Transformer from fia24 +author: John Snow Labs +name: filtered_annotated100k_mt5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`filtered_annotated100k_mt5_pipeline` is a English model originally trained by fia24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/filtered_annotated100k_mt5_pipeline_en_5.4.2_3.0_1724621200900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/filtered_annotated100k_mt5_pipeline_en_5.4.2_3.0_1724621200900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("filtered_annotated100k_mt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("filtered_annotated100k_mt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|filtered_annotated100k_mt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/fia24/filtered_annotated100k_mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_en.md b/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_en.md new file mode 100644 index 00000000000000..7fd6fcde8bf3d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fin_mt5_long_extract T5Transformer from dzadvornov +author: John Snow Labs +name: fin_mt5_long_extract +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fin_mt5_long_extract` is a English model originally trained by dzadvornov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fin_mt5_long_extract_en_5.4.2_3.0_1724549600182.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fin_mt5_long_extract_en_5.4.2_3.0_1724549600182.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fin_mt5_long_extract","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fin_mt5_long_extract", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fin_mt5_long_extract| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/dzadvornov/fin-mt5-long-extract \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_pipeline_en.md new file mode 100644 index 00000000000000..99421ae9b15a72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fin_mt5_long_extract_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fin_mt5_long_extract_pipeline pipeline T5Transformer from dzadvornov +author: John Snow Labs +name: fin_mt5_long_extract_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fin_mt5_long_extract_pipeline` is a English model originally trained by dzadvornov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fin_mt5_long_extract_pipeline_en_5.4.2_3.0_1724549758592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fin_mt5_long_extract_pipeline_en_5.4.2_3.0_1724549758592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fin_mt5_long_extract_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fin_mt5_long_extract_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fin_mt5_long_extract_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/dzadvornov/fin-mt5-long-extract + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_en.md b/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_en.md new file mode 100644 index 00000000000000..6810104a36625a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finalassginment_1211_sanghyo T5Transformer from sanghyo +author: John Snow Labs +name: finalassginment_1211_sanghyo +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finalassginment_1211_sanghyo` is a English model originally trained by sanghyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finalassginment_1211_sanghyo_en_5.4.2_3.0_1724554045791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finalassginment_1211_sanghyo_en_5.4.2_3.0_1724554045791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finalassginment_1211_sanghyo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finalassginment_1211_sanghyo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finalassginment_1211_sanghyo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.2 MB| + +## References + +https://huggingface.co/sanghyo/FinalAssginment_1211 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_pipeline_en.md new file mode 100644 index 00000000000000..d78a0bd99e6c40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finalassginment_1211_sanghyo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finalassginment_1211_sanghyo_pipeline pipeline T5Transformer from sanghyo +author: John Snow Labs +name: finalassginment_1211_sanghyo_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finalassginment_1211_sanghyo_pipeline` is a English model originally trained by sanghyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finalassginment_1211_sanghyo_pipeline_en_5.4.2_3.0_1724554064309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finalassginment_1211_sanghyo_pipeline_en_5.4.2_3.0_1724554064309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finalassginment_1211_sanghyo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finalassginment_1211_sanghyo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finalassginment_1211_sanghyo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.2 MB| + +## References + +https://huggingface.co/sanghyo/FinalAssginment_1211 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_en.md b/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_en.md new file mode 100644 index 00000000000000..5b6184be688846 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_flan_t5_20_epochs_2048_input_256_output T5Transformer from tanatapanun +author: John Snow Labs +name: fine_tuned_flan_t5_20_epochs_2048_input_256_output +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_flan_t5_20_epochs_2048_input_256_output` is a English model originally trained by tanatapanun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_20_epochs_2048_input_256_output_en_5.4.2_3.0_1724593053842.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_20_epochs_2048_input_256_output_en_5.4.2_3.0_1724593053842.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_flan_t5_20_epochs_2048_input_256_output","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_flan_t5_20_epochs_2048_input_256_output", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_flan_t5_20_epochs_2048_input_256_output| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/tanatapanun/fine-tuned-flan-t5-20-epochs-2048-input-256-output \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline_en.md new file mode 100644 index 00000000000000..0fd53bd9fc9849 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline pipeline T5Transformer from tanatapanun +author: John Snow Labs +name: fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline` is a English model originally trained by tanatapanun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline_en_5.4.2_3.0_1724593071195.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline_en_5.4.2_3.0_1724593071195.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_flan_t5_20_epochs_2048_input_256_output_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/tanatapanun/fine-tuned-flan-t5-20-epochs-2048-input-256-output + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_en.md new file mode 100644 index 00000000000000..1e29e1d92d3423 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver2 T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver2` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver2_en_5.4.2_3.0_1724601127146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver2_en_5.4.2_3.0_1724601127146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_pipeline_en.md new file mode 100644 index 00000000000000..20f68e4b15193b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetune_newwiki_summarization_ver2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver2_pipeline pipeline T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver2_pipeline` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver2_pipeline_en_5.4.2_3.0_1724601180405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver2_pipeline_en_5.4.2_3.0_1724601180405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_newwiki_summarization_ver2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_newwiki_summarization_ver2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_en.md new file mode 100644 index 00000000000000..d8cc52d61e9625 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_rut5_base_comments T5Transformer from rhythm00 +author: John Snow Labs +name: finetune_rut5_base_comments +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_rut5_base_comments` is a English model originally trained by rhythm00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_rut5_base_comments_en_5.4.2_3.0_1724609782873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_rut5_base_comments_en_5.4.2_3.0_1724609782873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_rut5_base_comments","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_rut5_base_comments", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_rut5_base_comments| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|988.7 MB| + +## References + +https://huggingface.co/rhythm00/finetune-rut5-base-comments \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_pipeline_en.md new file mode 100644 index 00000000000000..5d8c65a053f6d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetune_rut5_base_comments_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_rut5_base_comments_pipeline pipeline T5Transformer from rhythm00 +author: John Snow Labs +name: finetune_rut5_base_comments_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_rut5_base_comments_pipeline` is a English model originally trained by rhythm00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_rut5_base_comments_pipeline_en_5.4.2_3.0_1724609841447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_rut5_base_comments_pipeline_en_5.4.2_3.0_1724609841447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_rut5_base_comments_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_rut5_base_comments_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_rut5_base_comments_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|988.7 MB| + +## References + +https://huggingface.co/rhythm00/finetune-rut5-base-comments + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_en.md new file mode 100644 index 00000000000000..40521815773712 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_base_opus_books_translation T5Transformer from JinbiaoZhu +author: John Snow Labs +name: finetuned_t5_base_opus_books_translation +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_base_opus_books_translation` is a English model originally trained by JinbiaoZhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_opus_books_translation_en_5.4.2_3.0_1724598117632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_opus_books_translation_en_5.4.2_3.0_1724598117632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_base_opus_books_translation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_base_opus_books_translation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_base_opus_books_translation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|997.4 MB| + +## References + +https://huggingface.co/JinbiaoZhu/finetuned-t5-base-opus-books-Translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_pipeline_en.md new file mode 100644 index 00000000000000..4d0826f8010e4d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_base_opus_books_translation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_base_opus_books_translation_pipeline pipeline T5Transformer from JinbiaoZhu +author: John Snow Labs +name: finetuned_t5_base_opus_books_translation_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_base_opus_books_translation_pipeline` is a English model originally trained by JinbiaoZhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_opus_books_translation_pipeline_en_5.4.2_3.0_1724598168659.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_opus_books_translation_pipeline_en_5.4.2_3.0_1724598168659.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_base_opus_books_translation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_base_opus_books_translation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_base_opus_books_translation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|997.4 MB| + +## References + +https://huggingface.co/JinbiaoZhu/finetuned-t5-base-opus-books-Translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_en.md new file mode 100644 index 00000000000000..ce19234c67cbd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_summarize T5Transformer from cheenchan +author: John Snow Labs +name: finetuned_t5_summarize +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_summarize` is a English model originally trained by cheenchan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_summarize_en_5.4.2_3.0_1724596552199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_summarize_en_5.4.2_3.0_1724596552199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_summarize","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_summarize", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_summarize| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.7 MB| + +## References + +https://huggingface.co/cheenchan/finetuned_t5_summarize \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_pipeline_en.md new file mode 100644 index 00000000000000..3545da2a9ab2e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuned_t5_summarize_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_summarize_pipeline pipeline T5Transformer from cheenchan +author: John Snow Labs +name: finetuned_t5_summarize_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_summarize_pipeline` is a English model originally trained by cheenchan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_summarize_pipeline_en_5.4.2_3.0_1724596576200.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_summarize_pipeline_en_5.4.2_3.0_1724596576200.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_summarize_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_summarize_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_summarize_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.7 MB| + +## References + +https://huggingface.co/cheenchan/finetuned_t5_summarize + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_en.md new file mode 100644 index 00000000000000..a81b4cafada8a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetunef_t5_model_2c T5Transformer from MrBean123 +author: John Snow Labs +name: finetunef_t5_model_2c +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetunef_t5_model_2c` is a English model originally trained by MrBean123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetunef_t5_model_2c_en_5.4.2_3.0_1724599535188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetunef_t5_model_2c_en_5.4.2_3.0_1724599535188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetunef_t5_model_2c","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetunef_t5_model_2c", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetunef_t5_model_2c| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.7 MB| + +## References + +https://huggingface.co/MrBean123/finetunef_t5_model_2c \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_pipeline_en.md new file mode 100644 index 00000000000000..30d25983ccfebc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetunef_t5_model_2c_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetunef_t5_model_2c_pipeline pipeline T5Transformer from MrBean123 +author: John Snow Labs +name: finetunef_t5_model_2c_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetunef_t5_model_2c_pipeline` is a English model originally trained by MrBean123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetunef_t5_model_2c_pipeline_en_5.4.2_3.0_1724599554108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetunef_t5_model_2c_pipeline_en_5.4.2_3.0_1724599554108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetunef_t5_model_2c_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetunef_t5_model_2c_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetunef_t5_model_2c_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.7 MB| + +## References + +https://huggingface.co/MrBean123/finetunef_t5_model_2c + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_en.md new file mode 100644 index 00000000000000..0640f15bebbd17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuning_t5 T5Transformer from TGiang +author: John Snow Labs +name: finetuning_t5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuning_t5` is a English model originally trained by TGiang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuning_t5_en_5.4.2_3.0_1724572849618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuning_t5_en_5.4.2_3.0_1724572849618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuning_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuning_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuning_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|942.5 MB| + +## References + +https://huggingface.co/TGiang/finetuning_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_pipeline_en.md new file mode 100644 index 00000000000000..105b3c636b5b1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-finetuning_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuning_t5_pipeline pipeline T5Transformer from TGiang +author: John Snow Labs +name: finetuning_t5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuning_t5_pipeline` is a English model originally trained by TGiang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuning_t5_pipeline_en_5.4.2_3.0_1724572900895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuning_t5_pipeline_en_5.4.2_3.0_1724572900895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuning_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuning_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuning_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|942.5 MB| + +## References + +https://huggingface.co/TGiang/finetuning_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_en.md new file mode 100644 index 00000000000000..9cc7d5d8888684 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_large_req_extractor_seprator T5Transformer from divers +author: John Snow Labs +name: flan_large_req_extractor_seprator +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_large_req_extractor_seprator` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_large_req_extractor_seprator_en_5.4.2_3.0_1724615041762.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_large_req_extractor_seprator_en_5.4.2_3.0_1724615041762.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_large_req_extractor_seprator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_large_req_extractor_seprator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_large_req_extractor_seprator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/divers/flan-large-req-extractor-seprator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_pipeline_en.md new file mode 100644 index 00000000000000..1a125a753fae15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_large_req_extractor_seprator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_large_req_extractor_seprator_pipeline pipeline T5Transformer from divers +author: John Snow Labs +name: flan_large_req_extractor_seprator_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_large_req_extractor_seprator_pipeline` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_large_req_extractor_seprator_pipeline_en_5.4.2_3.0_1724615191350.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_large_req_extractor_seprator_pipeline_en_5.4.2_3.0_1724615191350.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_large_req_extractor_seprator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_large_req_extractor_seprator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_large_req_extractor_seprator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/divers/flan-large-req-extractor-seprator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_en.md new file mode 100644 index 00000000000000..9a77691e0bbbb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_001 T5Transformer from chuducandev +author: John Snow Labs +name: flan_t5_base_001 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_001` is a English model originally trained by chuducandev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_001_en_5.4.2_3.0_1724557343719.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_001_en_5.4.2_3.0_1724557343719.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_001","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_001", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_001| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/chuducandev/flan-t5-base-001 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_pipeline_en.md new file mode 100644 index 00000000000000..9f6b87c6fe340a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_001_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_001_pipeline pipeline T5Transformer from chuducandev +author: John Snow Labs +name: flan_t5_base_001_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_001_pipeline` is a English model originally trained by chuducandev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_001_pipeline_en_5.4.2_3.0_1724557390512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_001_pipeline_en_5.4.2_3.0_1724557390512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_001_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_001_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_001_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/chuducandev/flan-t5-base-001 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_en.md new file mode 100644 index 00000000000000..f16b59c159fd08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_6_3_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_3_cnndm +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_3_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_3_cnndm_en_5.4.2_3.0_1724594841678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_3_cnndm_en_5.4.2_3.0_1724594841678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_6_3_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_6_3_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_3_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|807.0 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-3-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..6b51925e7ba608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_6_3_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_6_3_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_3_cnndm_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_3_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_3_cnndm_pipeline_en_5.4.2_3.0_1724594880733.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_3_cnndm_pipeline_en_5.4.2_3.0_1724594880733.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_6_3_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_6_3_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_3_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|807.0 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-3-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_en.md new file mode 100644 index 00000000000000..73eb5ddd4b19c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_airline_sentiment_analysis T5Transformer from sudhanshusinghaiml +author: John Snow Labs +name: flan_t5_base_airline_sentiment_analysis +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_airline_sentiment_analysis` is a English model originally trained by sudhanshusinghaiml. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_airline_sentiment_analysis_en_5.4.2_3.0_1724599086487.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_airline_sentiment_analysis_en_5.4.2_3.0_1724599086487.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_airline_sentiment_analysis","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_airline_sentiment_analysis", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_airline_sentiment_analysis| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sudhanshusinghaiml/flan-t5-base-airline-sentiment-analysis \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_pipeline_en.md new file mode 100644 index 00000000000000..2afd5b4937591b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_airline_sentiment_analysis_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_airline_sentiment_analysis_pipeline pipeline T5Transformer from sudhanshusinghaiml +author: John Snow Labs +name: flan_t5_base_airline_sentiment_analysis_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_airline_sentiment_analysis_pipeline` is a English model originally trained by sudhanshusinghaiml. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_airline_sentiment_analysis_pipeline_en_5.4.2_3.0_1724599136995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_airline_sentiment_analysis_pipeline_en_5.4.2_3.0_1724599136995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_airline_sentiment_analysis_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_airline_sentiment_analysis_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_airline_sentiment_analysis_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sudhanshusinghaiml/flan-t5-base-airline-sentiment-analysis + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_en.md new file mode 100644 index 00000000000000..cbb39ad612c44d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_argmining_norwegian_knowledge T5Transformer from JoeyCheng +author: John Snow Labs +name: flan_t5_base_argmining_norwegian_knowledge +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_argmining_norwegian_knowledge` is a English model originally trained by JoeyCheng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_argmining_norwegian_knowledge_en_5.4.2_3.0_1724612627953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_argmining_norwegian_knowledge_en_5.4.2_3.0_1724612627953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_argmining_norwegian_knowledge","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_argmining_norwegian_knowledge", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_argmining_norwegian_knowledge| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JoeyCheng/flan_t5_base_argmining_no_knowledge \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_pipeline_en.md new file mode 100644 index 00000000000000..7d9593328ae38b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_argmining_norwegian_knowledge_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_argmining_norwegian_knowledge_pipeline pipeline T5Transformer from JoeyCheng +author: John Snow Labs +name: flan_t5_base_argmining_norwegian_knowledge_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_argmining_norwegian_knowledge_pipeline` is a English model originally trained by JoeyCheng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_argmining_norwegian_knowledge_pipeline_en_5.4.2_3.0_1724612675979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_argmining_norwegian_knowledge_pipeline_en_5.4.2_3.0_1724612675979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_argmining_norwegian_knowledge_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_argmining_norwegian_knowledge_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_argmining_norwegian_knowledge_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JoeyCheng/flan_t5_base_argmining_no_knowledge + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_en.md new file mode 100644 index 00000000000000..3e3c5e1d7f81f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_erionis_summarization T5Transformer from adjohn1313 +author: John Snow Labs +name: flan_t5_base_erionis_summarization +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_erionis_summarization` is a English model originally trained by adjohn1313. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_erionis_summarization_en_5.4.2_3.0_1724558684664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_erionis_summarization_en_5.4.2_3.0_1724558684664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_erionis_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_erionis_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_erionis_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/adjohn1313/flan-t5-base-erionis-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_pipeline_en.md new file mode 100644 index 00000000000000..018935ee3ccbdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_erionis_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_erionis_summarization_pipeline pipeline T5Transformer from adjohn1313 +author: John Snow Labs +name: flan_t5_base_erionis_summarization_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_erionis_summarization_pipeline` is a English model originally trained by adjohn1313. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_erionis_summarization_pipeline_en_5.4.2_3.0_1724558742498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_erionis_summarization_pipeline_en_5.4.2_3.0_1724558742498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_erionis_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_erionis_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_erionis_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/adjohn1313/flan-t5-base-erionis-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_en.md new file mode 100644 index 00000000000000..88ae7024ca89d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_en_5.4.2_3.0_1724586988000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_en_5.4.2_3.0_1724586988000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_4000-all-hint_precision-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline_en.md new file mode 100644 index 00000000000000..dd353079565889 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724587034742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724587034742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_4000_all_hint_precision_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_4000-all-hint_precision-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_en.md new file mode 100644 index 00000000000000..28f0eb5b4cfe6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_fce_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_fce_e8_b16 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fce_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fce_e8_b16_en_5.4.2_3.0_1724555898511.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fce_e8_b16_en_5.4.2_3.0_1724555898511.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_fce_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_fce_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fce_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-fce-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..bac23e4f60980d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_fce_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_fce_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_fce_e8_b16_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fce_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fce_e8_b16_pipeline_en_5.4.2_3.0_1724555948525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fce_e8_b16_pipeline_en_5.4.2_3.0_1724555948525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_fce_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_fce_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fce_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-fce-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_en.md new file mode 100644 index 00000000000000..cd207ec6afd811 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_instruct_dolly_hhrlhf T5Transformer from pszemraj +author: John Snow Labs +name: flan_t5_base_instruct_dolly_hhrlhf +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_instruct_dolly_hhrlhf` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_instruct_dolly_hhrlhf_en_5.4.2_3.0_1724573594023.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_instruct_dolly_hhrlhf_en_5.4.2_3.0_1724573594023.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_instruct_dolly_hhrlhf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_instruct_dolly_hhrlhf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_instruct_dolly_hhrlhf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pszemraj/flan-t5-base-instruct-dolly_hhrlhf \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_pipeline_en.md new file mode 100644 index 00000000000000..8e2418cc69d885 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_instruct_dolly_hhrlhf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_instruct_dolly_hhrlhf_pipeline pipeline T5Transformer from pszemraj +author: John Snow Labs +name: flan_t5_base_instruct_dolly_hhrlhf_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_instruct_dolly_hhrlhf_pipeline` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_instruct_dolly_hhrlhf_pipeline_en_5.4.2_3.0_1724573643969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_instruct_dolly_hhrlhf_pipeline_en_5.4.2_3.0_1724573643969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_instruct_dolly_hhrlhf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_instruct_dolly_hhrlhf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_instruct_dolly_hhrlhf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pszemraj/flan-t5-base-instruct-dolly_hhrlhf + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_en.md new file mode 100644 index 00000000000000..c9597376d34f49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_master_case_l T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_case_l +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_case_l` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_case_l_en_5.4.2_3.0_1724553096218.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_case_l_en_5.4.2_3.0_1724553096218.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_master_case_l","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_master_case_l", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_case_l| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-case-l \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_pipeline_en.md new file mode 100644 index 00000000000000..7c117a8a9b801e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_case_l_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_master_case_l_pipeline pipeline T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_case_l_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_case_l_pipeline` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_case_l_pipeline_en_5.4.2_3.0_1724553145702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_case_l_pipeline_en_5.4.2_3.0_1724553145702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_master_case_l_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_master_case_l_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_case_l_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-case-l + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_en.md new file mode 100644 index 00000000000000..9ab559b1e8a391 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_master T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_en_5.4.2_3.0_1724599675505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_en_5.4.2_3.0_1724599675505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_master","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_master", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_en.md new file mode 100644 index 00000000000000..aa6f0b3fd42242 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_master_final T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_final +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_final` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_final_en_5.4.2_3.0_1724574798353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_final_en_5.4.2_3.0_1724574798353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_master_final","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_master_final", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_final| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-final \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_pipeline_en.md new file mode 100644 index 00000000000000..0b541c714461a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_final_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_master_final_pipeline pipeline T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_final_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_final_pipeline` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_final_pipeline_en_5.4.2_3.0_1724574846215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_final_pipeline_en_5.4.2_3.0_1724574846215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_master_final_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_master_final_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_final_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-final + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_pipeline_en.md new file mode 100644 index 00000000000000..e4ec4e2a07d634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_master_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_master_pipeline pipeline T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_pipeline` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_pipeline_en_5.4.2_3.0_1724599725747.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_pipeline_en_5.4.2_3.0_1724599725747.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_master_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_master_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_en.md new file mode 100644 index 00000000000000..6ba095a274fdb2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_jiajunzhu T5Transformer from jiajunzhu +author: John Snow Labs +name: flan_t5_base_samsum_jiajunzhu +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_jiajunzhu` is a English model originally trained by jiajunzhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_jiajunzhu_en_5.4.2_3.0_1724600697572.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_jiajunzhu_en_5.4.2_3.0_1724600697572.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_jiajunzhu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_jiajunzhu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_jiajunzhu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jiajunzhu/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_pipeline_en.md new file mode 100644 index 00000000000000..cf9c0956f48099 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_jiajunzhu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_jiajunzhu_pipeline pipeline T5Transformer from jiajunzhu +author: John Snow Labs +name: flan_t5_base_samsum_jiajunzhu_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_jiajunzhu_pipeline` is a English model originally trained by jiajunzhu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_jiajunzhu_pipeline_en_5.4.2_3.0_1724600750521.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_jiajunzhu_pipeline_en_5.4.2_3.0_1724600750521.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_jiajunzhu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_jiajunzhu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_jiajunzhu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jiajunzhu/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_en.md new file mode 100644 index 00000000000000..83c96b87ea7cb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_pamelaborelli T5Transformer from PamelaBorelli +author: John Snow Labs +name: flan_t5_base_samsum_pamelaborelli +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_pamelaborelli` is a English model originally trained by PamelaBorelli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_pamelaborelli_en_5.4.2_3.0_1724613672586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_pamelaborelli_en_5.4.2_3.0_1724613672586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_pamelaborelli","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_pamelaborelli", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_pamelaborelli| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PamelaBorelli/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_pipeline_en.md new file mode 100644 index 00000000000000..5237b1cff351b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_pamelaborelli_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_pamelaborelli_pipeline pipeline T5Transformer from PamelaBorelli +author: John Snow Labs +name: flan_t5_base_samsum_pamelaborelli_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_pamelaborelli_pipeline` is a English model originally trained by PamelaBorelli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_pamelaborelli_pipeline_en_5.4.2_3.0_1724613723369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_pamelaborelli_pipeline_en_5.4.2_3.0_1724613723369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_pamelaborelli_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_pamelaborelli_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_pamelaborelli_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PamelaBorelli/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_en.md new file mode 100644 index 00000000000000..648f10caf8178f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_texasdave2 T5Transformer from texasdave2 +author: John Snow Labs +name: flan_t5_base_samsum_texasdave2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_texasdave2` is a English model originally trained by texasdave2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_texasdave2_en_5.4.2_3.0_1724587362382.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_texasdave2_en_5.4.2_3.0_1724587362382.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_texasdave2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_texasdave2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_texasdave2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/texasdave2/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_pipeline_en.md new file mode 100644 index 00000000000000..73bb9061385eca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_samsum_texasdave2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_texasdave2_pipeline pipeline T5Transformer from texasdave2 +author: John Snow Labs +name: flan_t5_base_samsum_texasdave2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_texasdave2_pipeline` is a English model originally trained by texasdave2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_texasdave2_pipeline_en_5.4.2_3.0_1724587410227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_texasdave2_pipeline_en_5.4.2_3.0_1724587410227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_texasdave2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_texasdave2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_texasdave2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/texasdave2/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_en.md new file mode 100644 index 00000000000000..0f7476a82a62af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_squad_qag_ep6 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qag_ep6 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag_ep6` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep6_en_5.4.2_3.0_1724608162642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep6_en_5.4.2_3.0_1724608162642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_squad_qag_ep6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_squad_qag_ep6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag_ep6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qag-ep6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_pipeline_en.md new file mode 100644 index 00000000000000..aea0a5dd4d8091 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_squad_qag_ep6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_squad_qag_ep6_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qag_ep6_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag_ep6_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724608214798.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724608214798.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_squad_qag_ep6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_squad_qag_ep6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag_ep6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qag-ep6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_en.md new file mode 100644 index 00000000000000..b7ee17ca50717e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_vg_factual_sango T5Transformer from lizhuang144 +author: John Snow Labs +name: flan_t5_base_vg_factual_sango +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_vg_factual_sango` is a English model originally trained by lizhuang144. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_vg_factual_sango_en_5.4.2_3.0_1724629259414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_vg_factual_sango_en_5.4.2_3.0_1724629259414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_vg_factual_sango","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_vg_factual_sango", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_vg_factual_sango| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lizhuang144/flan-t5-base-VG-factual-sg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_pipeline_en.md new file mode 100644 index 00000000000000..ffe50ca122def8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_base_vg_factual_sango_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_vg_factual_sango_pipeline pipeline T5Transformer from lizhuang144 +author: John Snow Labs +name: flan_t5_base_vg_factual_sango_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_vg_factual_sango_pipeline` is a English model originally trained by lizhuang144. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_vg_factual_sango_pipeline_en_5.4.2_3.0_1724629306826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_vg_factual_sango_pipeline_en_5.4.2_3.0_1724629306826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_vg_factual_sango_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_vg_factual_sango_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_vg_factual_sango_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lizhuang144/flan-t5-base-VG-factual-sg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_en.md new file mode 100644 index 00000000000000..b154d7e48faa33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_booksum_qg T5Transformer from logits +author: John Snow Labs +name: flan_t5_booksum_qg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_booksum_qg` is a English model originally trained by logits. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_qg_en_5.4.2_3.0_1724583697548.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_qg_en_5.4.2_3.0_1724583697548.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_booksum_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_booksum_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_booksum_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/logits/flan-t5-booksum-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_pipeline_en.md new file mode 100644 index 00000000000000..c87482dae8f923 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_booksum_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_booksum_qg_pipeline pipeline T5Transformer from logits +author: John Snow Labs +name: flan_t5_booksum_qg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_booksum_qg_pipeline` is a English model originally trained by logits. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_qg_pipeline_en_5.4.2_3.0_1724583826465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_qg_pipeline_en_5.4.2_3.0_1724583826465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_booksum_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_booksum_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_booksum_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/logits/flan-t5-booksum-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_en.md new file mode 100644 index 00000000000000..058242e6969d88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_alt_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_alt_small_finetuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_alt_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_small_finetuned_en_5.4.2_3.0_1724573258234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_small_finetuned_en_5.4.2_3.0_1724573258234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_alt_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_alt_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_alt_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-alt-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..f5e41994291847 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_cbp_lkg_alt_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_alt_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_alt_small_finetuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_alt_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_small_finetuned_pipeline_en_5.4.2_3.0_1724573275163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_small_finetuned_pipeline_en_5.4.2_3.0_1724573275163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_cbp_lkg_alt_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_cbp_lkg_alt_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_alt_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-alt-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_en.md new file mode 100644 index 00000000000000..91b534878ab776 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr2e_4 T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr2e_4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr2e_4` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr2e_4_en_5.4.2_3.0_1724544074877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr2e_4_en_5.4.2_3.0_1724544074877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr2e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr2e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr2e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr2e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_pipeline_en.md new file mode 100644 index 00000000000000..8751aaf9be12a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_glue_finetuning_lr2e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr2e_4_pipeline pipeline T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr2e_4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr2e_4_pipeline` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr2e_4_pipeline_en_5.4.2_3.0_1724544121014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr2e_4_pipeline_en_5.4.2_3.0_1724544121014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_glue_finetuning_lr2e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_glue_finetuning_lr2e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr2e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr2e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_en.md new file mode 100644 index 00000000000000..f8e259ba351f42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_interact T5Transformer from Jithendra-k +author: John Snow Labs +name: flan_t5_interact +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_interact` is a English model originally trained by Jithendra-k. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_interact_en_5.4.2_3.0_1724579642138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_interact_en_5.4.2_3.0_1724579642138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_interact","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_interact", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_interact| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jithendra-k/Flan_T5_InterACT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_pipeline_en.md new file mode 100644 index 00000000000000..9ba30633ff66b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_interact_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_interact_pipeline pipeline T5Transformer from Jithendra-k +author: John Snow Labs +name: flan_t5_interact_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_interact_pipeline` is a English model originally trained by Jithendra-k. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_interact_pipeline_en_5.4.2_3.0_1724579687838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_interact_pipeline_en_5.4.2_3.0_1724579687838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_interact_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_interact_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_interact_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jithendra-k/Flan_T5_InterACT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_en.md new file mode 100644 index 00000000000000..5c062877ade06e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_w_context_small +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_en_5.4.2_3.0_1724581441233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_en_5.4.2_3.0_1724581441233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.4 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..230f554987d67c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline_en_5.4.2_3.0_1724581457850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline_en_5.4.2_3.0_1724581457850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.4 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_en.md new file mode 100644 index 00000000000000..117ea1b85703ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_6_1_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_large_6_1_cnndm +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_6_1_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_6_1_cnndm_en_5.4.2_3.0_1724618593534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_6_1_cnndm_en_5.4.2_3.0_1724618593534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_6_1_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_6_1_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_6_1_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.8 GB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-large-6-1-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..2c294a7d81511e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_6_1_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_6_1_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_large_6_1_cnndm_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_6_1_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_6_1_cnndm_pipeline_en_5.4.2_3.0_1724618684063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_6_1_cnndm_pipeline_en_5.4.2_3.0_1724618684063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_6_1_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_6_1_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_6_1_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.8 GB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-large-6-1-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_common_gen_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_common_gen_en.md new file mode 100644 index 00000000000000..c65d2db28cc6ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_common_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_common_gen T5Transformer from mrm8488 +author: John Snow Labs +name: flan_t5_large_common_gen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_common_gen` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_common_gen_en_5.4.2_3.0_1724605059500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_common_gen_en_5.4.2_3.0_1724605059500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_common_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_common_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_common_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/mrm8488/flan-t5-large-common_gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_en.md new file mode 100644 index 00000000000000..d2c14c3d666e6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_en_5.4.2_3.0_1724553759755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_en_5.4.2_3.0_1724553759755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_400-ep10-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..9f91d5f71608e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline_en_5.4.2_3.0_1724553910488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline_en_5.4.2_3.0_1724553910488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_400_ep10_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_400-ep10-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_en.md new file mode 100644 index 00000000000000..2f6e58d31de04b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_dm_2000_ep25_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_dm_2000_ep25_nonstop +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_dm_2000_ep25_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_2000_ep25_nonstop_en_5.4.2_3.0_1724617914155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_2000_ep25_nonstop_en_5.4.2_3.0_1724617914155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_dm_2000_ep25_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_dm_2000_ep25_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_dm_2000_ep25_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-dm_2000-ep25-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..4ed05372527fac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline_en_5.4.2_3.0_1724618051044.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline_en_5.4.2_3.0_1724618051044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_dm_2000_ep25_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-dm_2000-ep25-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_en.md new file mode 100644 index 00000000000000..32e8aa8943b7b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_8000_all_loss_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_8000_all_loss_ep10 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_8000_all_loss_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_loss_ep10_en_5.4.2_3.0_1724572209033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_loss_ep10_en_5.4.2_3.0_1724572209033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_8000_all_loss_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_8000_all_loss_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_8000_all_loss_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_8000-all-loss-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline_en.md new file mode 100644 index 00000000000000..2585cf1e87c5d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline_en_5.4.2_3.0_1724572343862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline_en_5.4.2_3.0_1724572343862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_8000_all_loss_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_8000-all-loss-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_en.md new file mode 100644 index 00000000000000..7277ce6bff1e5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_91 T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_91 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_91` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_91_en_5.4.2_3.0_1724557758902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_91_en_5.4.2_3.0_1724557758902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_91","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_91", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_91| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_91 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_pipeline_en.md new file mode 100644 index 00000000000000..927cd6b5dbc3c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_91_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_91_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_91_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_91_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_91_pipeline_en_5.4.2_3.0_1724557887638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_91_pipeline_en_5.4.2_3.0_1724557887638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_91_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_91_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_91_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_91 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_en.md new file mode 100644 index 00000000000000..faf288da6bcbac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_hyp T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_hyp +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_hyp` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_hyp_en_5.4.2_3.0_1724566799279.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_hyp_en_5.4.2_3.0_1724566799279.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_hyp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_hyp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_hyp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_hyp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_pipeline_en.md new file mode 100644 index 00000000000000..7c91664c20fe17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_hyp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_hyp_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_hyp_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_hyp_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_hyp_pipeline_en_5.4.2_3.0_1724566947212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_hyp_pipeline_en_5.4.2_3.0_1724566947212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_hyp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_hyp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_hyp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_hyp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_lr_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_lr_en.md new file mode 100644 index 00000000000000..54a927ca1a2e80 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_medistill_lr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_lr T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_lr +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_lr` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_lr_en_5.4.2_3.0_1724595313912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_lr_en_5.4.2_3.0_1724595313912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_lr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_lr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_lr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_LR \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_en.md new file mode 100644 index 00000000000000..86c4dddae8ba2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_pubmed_qa_pqa_artificial T5Transformer from atrost +author: John Snow Labs +name: flan_t5_large_pubmed_qa_pqa_artificial +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_pubmed_qa_pqa_artificial` is a English model originally trained by atrost. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_pubmed_qa_pqa_artificial_en_5.4.2_3.0_1724590001369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_pubmed_qa_pqa_artificial_en_5.4.2_3.0_1724590001369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_pubmed_qa_pqa_artificial","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_pubmed_qa_pqa_artificial", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_pubmed_qa_pqa_artificial| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/atrost/flan-t5-large-pubmed_qa-pqa_artificial \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_pipeline_en.md new file mode 100644 index 00000000000000..5923e5319f4774 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_large_pubmed_qa_pqa_artificial_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_pubmed_qa_pqa_artificial_pipeline pipeline T5Transformer from atrost +author: John Snow Labs +name: flan_t5_large_pubmed_qa_pqa_artificial_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_pubmed_qa_pqa_artificial_pipeline` is a English model originally trained by atrost. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_pubmed_qa_pqa_artificial_pipeline_en_5.4.2_3.0_1724590139674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_pubmed_qa_pqa_artificial_pipeline_en_5.4.2_3.0_1724590139674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_pubmed_qa_pqa_artificial_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_pubmed_qa_pqa_artificial_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_pubmed_qa_pqa_artificial_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/atrost/flan-t5-large-pubmed_qa-pqa_artificial + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_en.md new file mode 100644 index 00000000000000..0ace003f975891 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_qg_learningq_tarek_test_v1 T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_learningq_tarek_test_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_learningq_tarek_test_v1` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_learningq_tarek_test_v1_en_5.4.2_3.0_1724597777360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_learningq_tarek_test_v1_en_5.4.2_3.0_1724597777360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_qg_learningq_tarek_test_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_qg_learningq_tarek_test_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_learningq_tarek_test_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.3 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-LearningQ-tarek-test-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_pipeline_en.md new file mode 100644 index 00000000000000..17a752fde29bf9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_qg_learningq_tarek_test_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_qg_learningq_tarek_test_v1_pipeline pipeline T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_learningq_tarek_test_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_learningq_tarek_test_v1_pipeline` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_learningq_tarek_test_v1_pipeline_en_5.4.2_3.0_1724597794381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_learningq_tarek_test_v1_pipeline_en_5.4.2_3.0_1724597794381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_qg_learningq_tarek_test_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_qg_learningq_tarek_test_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_learningq_tarek_test_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.3 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-LearningQ-tarek-test-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_en.md new file mode 100644 index 00000000000000..bea21c5dfdacd3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_small_finetuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_small_finetuned_en_5.4.2_3.0_1724601858646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_small_finetuned_en_5.4.2_3.0_1724601858646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..56c3cb3aee1200 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_small_finetuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_small_finetuned_pipeline_en_5.4.2_3.0_1724601877052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_small_finetuned_pipeline_en_5.4.2_3.0_1724601877052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_direct_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_direct_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_en.md new file mode 100644 index 00000000000000..0b77c586c589ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_small_finetuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_finetuned_en_5.4.2_3.0_1724591571644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_finetuned_en_5.4.2_3.0_1724591571644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..10c3f558a00b82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724591588756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724591588756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_en.md new file mode 100644 index 00000000000000..30f64d0cc91717 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_en_5.4.2_3.0_1724582891553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_en_5.4.2_3.0_1724582891553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-var-len-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..05b39819e141eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline_en_5.4.2_3.0_1724582907617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline_en_5.4.2_3.0_1724582907617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_var_len_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-var-len-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_en.md new file mode 100644 index 00000000000000..9a8d128caae45b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_1_1_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_1_1_cnndm +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_1_1_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_1_cnndm_en_5.4.2_3.0_1724622088540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_1_cnndm_en_5.4.2_3.0_1724622088540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_1_1_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_1_1_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_1_1_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|205.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-1-1-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..1a23601e402fa2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_1_1_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_1_1_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_1_1_cnndm_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_1_1_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_1_cnndm_pipeline_en_5.4.2_3.0_1724622098663.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_1_1_cnndm_pipeline_en_5.4.2_3.0_1724622098663.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_1_1_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_1_1_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_1_1_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|205.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-1-1-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_en.md new file mode 100644 index 00000000000000..3d22ad4e171504 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_3_3_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_3_3_cnndm +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_3_3_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_3_3_cnndm_en_5.4.2_3.0_1724586824964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_3_3_cnndm_en_5.4.2_3.0_1724586824964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_3_3_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_3_3_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_3_3_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|267.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-3-3-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..78605d6f42da86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_3_3_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_3_3_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_3_3_cnndm_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_3_3_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_3_3_cnndm_pipeline_en_5.4.2_3.0_1724586837668.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_3_3_cnndm_pipeline_en_5.4.2_3.0_1724586837668.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_3_3_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_3_3_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_3_3_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|267.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-3-3-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_en.md new file mode 100644 index 00000000000000..1e0258be1319a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_4_6_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_4_6_cnndm +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_4_6_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_6_cnndm_en_5.4.2_3.0_1724607164564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_6_cnndm_en_5.4.2_3.0_1724607164564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_4_6_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_4_6_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_4_6_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-4-6-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..622c0e8fc16d37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_4_6_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_4_6_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_4_6_cnndm_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_4_6_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_6_cnndm_pipeline_en_5.4.2_3.0_1724607180317.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_4_6_cnndm_pipeline_en_5.4.2_3.0_1724607180317.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_4_6_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_4_6_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_4_6_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-4-6-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_en.md new file mode 100644 index 00000000000000..aa17b45116f065 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_codesearchnet_python T5Transformer from lmeninato +author: John Snow Labs +name: flan_t5_small_codesearchnet_python +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_codesearchnet_python` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_codesearchnet_python_en_5.4.2_3.0_1724586245804.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_codesearchnet_python_en_5.4.2_3.0_1724586245804.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_codesearchnet_python","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_codesearchnet_python", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_codesearchnet_python| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lmeninato/flan-t5-small-codesearchnet-python \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_pipeline_en.md new file mode 100644 index 00000000000000..98325f8a346e5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_codesearchnet_python_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_codesearchnet_python_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: flan_t5_small_codesearchnet_python_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_codesearchnet_python_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_codesearchnet_python_pipeline_en_5.4.2_3.0_1724586262179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_codesearchnet_python_pipeline_en_5.4.2_3.0_1724586262179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_codesearchnet_python_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_codesearchnet_python_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_codesearchnet_python_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lmeninato/flan-t5-small-codesearchnet-python + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_en.md new file mode 100644 index 00000000000000..508b6fc7aa0a1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_youtube_videos T5Transformer from ANWAR101 +author: John Snow Labs +name: flan_t5_small_finetuned_youtube_videos +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_youtube_videos` is a English model originally trained by ANWAR101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_youtube_videos_en_5.4.2_3.0_1724603288891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_youtube_videos_en_5.4.2_3.0_1724603288891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_youtube_videos","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_youtube_videos", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_youtube_videos| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/ANWAR101/flan-t5-small-finetuned-youtube-videos \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_pipeline_en.md new file mode 100644 index 00000000000000..1037a802e3bc2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_finetuned_youtube_videos_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_youtube_videos_pipeline pipeline T5Transformer from ANWAR101 +author: John Snow Labs +name: flan_t5_small_finetuned_youtube_videos_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_youtube_videos_pipeline` is a English model originally trained by ANWAR101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_youtube_videos_pipeline_en_5.4.2_3.0_1724603306660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_youtube_videos_pipeline_en_5.4.2_3.0_1724603306660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_youtube_videos_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_youtube_videos_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_youtube_videos_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/ANWAR101/flan-t5-small-finetuned-youtube-videos + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_en.md new file mode 100644 index 00000000000000..65315ea07dd05d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_sample T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_sample +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_sample` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_sample_en_5.4.2_3.0_1724609863180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_sample_en_5.4.2_3.0_1724609863180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_sample","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_sample", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_sample| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-sample \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_pipeline_en.md new file mode 100644 index 00000000000000..3c6df8c32d2f3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_sample_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_sample_pipeline pipeline T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_sample_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_sample_pipeline` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_sample_pipeline_en_5.4.2_3.0_1724609880573.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_sample_pipeline_en_5.4.2_3.0_1724609880573.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_sample_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_sample_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_sample_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-sample + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_en.md new file mode 100644 index 00000000000000..59f8dcdec576e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_tempo_wic T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tempo_wic +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tempo_wic` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tempo_wic_en_5.4.2_3.0_1724616877493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tempo_wic_en_5.4.2_3.0_1724616877493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_tempo_wic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_tempo_wic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tempo_wic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tempo-wic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_pipeline_en.md new file mode 100644 index 00000000000000..b4d7a8926e5b0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flan_t5_small_tempo_wic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_tempo_wic_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tempo_wic_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tempo_wic_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tempo_wic_pipeline_en_5.4.2_3.0_1724616895836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tempo_wic_pipeline_en_5.4.2_3.0_1724616895836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_tempo_wic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_tempo_wic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tempo_wic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tempo-wic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_de.md b/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_de.md new file mode 100644 index 00000000000000..43b9553efd99d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German flant5_offensive_german_germ_train T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_german_germ_train +date: 2024-08-25 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_german_germ_train` is a German model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_germ_train_de_5.4.2_3.0_1724625655057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_germ_train_de_5.4.2_3.0_1724625655057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_offensive_german_germ_train","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_offensive_german_germ_train", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_german_germ_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/flant5_offensive_German_germ_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_pipeline_de.md new file mode 100644 index 00000000000000..26dc8bdc0bbaab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flant5_offensive_german_germ_train_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German flant5_offensive_german_germ_train_pipeline pipeline T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_german_germ_train_pipeline +date: 2024-08-25 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_german_germ_train_pipeline` is a German model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_germ_train_pipeline_de_5.4.2_3.0_1724625702624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_germ_train_pipeline_de_5.4.2_3.0_1724625702624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_offensive_german_germ_train_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_offensive_german_germ_train_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_german_germ_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/flant5_offensive_German_germ_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_en.md new file mode 100644 index 00000000000000..3aba5c972abc8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_opensource_and_tuned T5Transformer from mixtralyanis +author: John Snow Labs +name: flant5_opensource_and_tuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_opensource_and_tuned` is a English model originally trained by mixtralyanis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_opensource_and_tuned_en_5.4.2_3.0_1724603018924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_opensource_and_tuned_en_5.4.2_3.0_1724603018924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_opensource_and_tuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_opensource_and_tuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_opensource_and_tuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/mixtralyanis/flant5-opensource-and-tuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_pipeline_en.md new file mode 100644 index 00000000000000..66dffb1c2769c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-flant5_opensource_and_tuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_opensource_and_tuned_pipeline pipeline T5Transformer from mixtralyanis +author: John Snow Labs +name: flant5_opensource_and_tuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_opensource_and_tuned_pipeline` is a English model originally trained by mixtralyanis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_opensource_and_tuned_pipeline_en_5.4.2_3.0_1724603036741.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_opensource_and_tuned_pipeline_en_5.4.2_3.0_1724603036741.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_opensource_and_tuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_opensource_and_tuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_opensource_and_tuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/mixtralyanis/flant5-opensource-and-tuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_fr.md b/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_fr.md new file mode 100644 index 00000000000000..f468a83b5cb359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French frame_semantic_transformer_french_small T5Transformer from nelsonjq +author: John Snow Labs +name: frame_semantic_transformer_french_small +date: 2024-08-25 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`frame_semantic_transformer_french_small` is a French model originally trained by nelsonjq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/frame_semantic_transformer_french_small_fr_5.4.2_3.0_1724599052745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/frame_semantic_transformer_french_small_fr_5.4.2_3.0_1724599052745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("frame_semantic_transformer_french_small","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("frame_semantic_transformer_french_small", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|frame_semantic_transformer_french_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|345.7 MB| + +## References + +https://huggingface.co/nelsonjq/frame-semantic-transformer-french-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_pipeline_fr.md new file mode 100644 index 00000000000000..4f76e159bda513 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-frame_semantic_transformer_french_small_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French frame_semantic_transformer_french_small_pipeline pipeline T5Transformer from nelsonjq +author: John Snow Labs +name: frame_semantic_transformer_french_small_pipeline +date: 2024-08-25 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`frame_semantic_transformer_french_small_pipeline` is a French model originally trained by nelsonjq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/frame_semantic_transformer_french_small_pipeline_fr_5.4.2_3.0_1724599070958.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/frame_semantic_transformer_french_small_pipeline_fr_5.4.2_3.0_1724599070958.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("frame_semantic_transformer_french_small_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("frame_semantic_transformer_french_small_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|frame_semantic_transformer_french_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|345.7 MB| + +## References + +https://huggingface.co/nelsonjq/frame-semantic-transformer-french-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_en.md new file mode 100644 index 00000000000000..2b779431399cf9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft5_ishwarbb23 T5Transformer from ishwarbb23 +author: John Snow Labs +name: ft5_ishwarbb23 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft5_ishwarbb23` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft5_ishwarbb23_en_5.4.2_3.0_1724574347162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft5_ishwarbb23_en_5.4.2_3.0_1724574347162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft5_ishwarbb23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft5_ishwarbb23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft5_ishwarbb23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/ft5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_pipeline_en.md new file mode 100644 index 00000000000000..4dde5f16ddc6cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft5_ishwarbb23_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft5_ishwarbb23_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: ft5_ishwarbb23_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft5_ishwarbb23_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft5_ishwarbb23_pipeline_en_5.4.2_3.0_1724574398441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft5_ishwarbb23_pipeline_en_5.4.2_3.0_1724574398441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft5_ishwarbb23_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft5_ishwarbb23_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft5_ishwarbb23_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/ft5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_en.md new file mode 100644 index 00000000000000..a523f91815a64c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_aviationqa_aviationcorpusandaviationtriples_20 T5Transformer from sakharamg +author: John Snow Labs +name: ft_aviationqa_aviationcorpusandaviationtriples_20 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aviationqa_aviationcorpusandaviationtriples_20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aviationqa_aviationcorpusandaviationtriples_20_en_5.4.2_3.0_1724552379971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aviationqa_aviationcorpusandaviationtriples_20_en_5.4.2_3.0_1724552379971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_aviationqa_aviationcorpusandaviationtriples_20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_aviationqa_aviationcorpusandaviationtriples_20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aviationqa_aviationcorpusandaviationtriples_20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aviationqa_aviationcorpusAndaviationtriples_20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline_en.md new file mode 100644 index 00000000000000..a6c5e1d7aecc12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline_en_5.4.2_3.0_1724552529987.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline_en_5.4.2_3.0_1724552529987.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aviationqa_aviationcorpusandaviationtriples_20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aviationqa_aviationcorpusAndaviationtriples_20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_t5_large_en.md new file mode 100644 index 00000000000000..343784f0b19c82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_aviationqa_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_aviationqa_t5_large T5Transformer from sakharamg +author: John Snow Labs +name: ft_aviationqa_t5_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aviationqa_t5_large` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aviationqa_t5_large_en_5.4.2_3.0_1724577781660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aviationqa_t5_large_en_5.4.2_3.0_1724577781660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_aviationqa_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_aviationqa_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aviationqa_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aviationqa_t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_2hop_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_2hop_t5_large_en.md new file mode 100644 index 00000000000000..673687236a4900 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_2hop_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_metaqa_2hop_t5_large T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_2hop_t5_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_2hop_t5_large` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_t5_large_en_5.4.2_3.0_1724605103336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_t5_large_en_5.4.2_3.0_1724605103336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_metaqa_2hop_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_metaqa_2hop_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_2hop_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_2hop_t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_en.md new file mode 100644 index 00000000000000..bb0d024a9fac4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500 T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_en_5.4.2_3.0_1724588625600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_en_5.4.2_3.0_1724588625600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_3hop_top3_COLBERT_multihopcheckpoint-109500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline_en.md new file mode 100644 index 00000000000000..a4181e0744d26f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline_en_5.4.2_3.0_1724588760227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline_en_5.4.2_3.0_1724588760227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_3hop_top3_colbert_multihopcheckpoint_109500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_3hop_top3_COLBERT_multihopcheckpoint-109500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_en.md b/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_en.md new file mode 100644 index 00000000000000..0d80eeee993119 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English full_nvp2500 T5Transformer from mika5883 +author: John Snow Labs +name: full_nvp2500 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`full_nvp2500` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/full_nvp2500_en_5.4.2_3.0_1724601233169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/full_nvp2500_en_5.4.2_3.0_1724601233169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("full_nvp2500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("full_nvp2500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|full_nvp2500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Full_NVP2500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_pipeline_en.md new file mode 100644 index 00000000000000..a6581cd35c89eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-full_nvp2500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English full_nvp2500_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: full_nvp2500_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`full_nvp2500_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/full_nvp2500_pipeline_en_5.4.2_3.0_1724601282758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/full_nvp2500_pipeline_en_5.4.2_3.0_1724601282758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("full_nvp2500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("full_nvp2500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|full_nvp2500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Full_NVP2500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fyp_en.md b/docs/_posts/ahmedlone127/2024-08-25-fyp_en.md new file mode 100644 index 00000000000000..f1baf31702502d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fyp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fyp T5Transformer from yaashwardhan +author: John Snow Labs +name: fyp +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fyp` is a English model originally trained by yaashwardhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fyp_en_5.4.2_3.0_1724581365259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fyp_en_5.4.2_3.0_1724581365259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fyp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fyp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fyp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yaashwardhan/fyp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-fyp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-fyp_pipeline_en.md new file mode 100644 index 00000000000000..c65de25583da2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-fyp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fyp_pipeline pipeline T5Transformer from yaashwardhan +author: John Snow Labs +name: fyp_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fyp_pipeline` is a English model originally trained by yaashwardhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fyp_pipeline_en_5.4.2_3.0_1724581412431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fyp_pipeline_en_5.4.2_3.0_1724581412431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fyp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fyp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fyp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yaashwardhan/fyp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_en.md b/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_en.md new file mode 100644 index 00000000000000..5c4ec22dcc7a14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English general_paraphrase T5Transformer from ieuniversity +author: John Snow Labs +name: general_paraphrase +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`general_paraphrase` is a English model originally trained by ieuniversity. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/general_paraphrase_en_5.4.2_3.0_1724579380417.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/general_paraphrase_en_5.4.2_3.0_1724579380417.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("general_paraphrase","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("general_paraphrase", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|general_paraphrase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ieuniversity/general_paraphrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_pipeline_en.md new file mode 100644 index 00000000000000..b58535d3472587 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-general_paraphrase_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English general_paraphrase_pipeline pipeline T5Transformer from ieuniversity +author: John Snow Labs +name: general_paraphrase_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`general_paraphrase_pipeline` is a English model originally trained by ieuniversity. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/general_paraphrase_pipeline_en_5.4.2_3.0_1724579428568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/general_paraphrase_pipeline_en_5.4.2_3.0_1724579428568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("general_paraphrase_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("general_paraphrase_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|general_paraphrase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ieuniversity/general_paraphrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_de.md b/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_de.md new file mode 100644 index 00000000000000..140817421a932c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_longt5_large_256 T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large_256 +date: 2024-08-25 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large_256` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_256_de_5.4.2_3.0_1724590442035.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_256_de_5.4.2_3.0_1724590442035.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_longt5_large_256","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_longt5_large_256", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large_256| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large-256 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_pipeline_de.md new file mode 100644 index 00000000000000..8eebd119a88e6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-german_jeopardy_longt5_large_256_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_longt5_large_256_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large_256_pipeline +date: 2024-08-25 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large_256_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_256_pipeline_de_5.4.2_3.0_1724590578974.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_256_pipeline_de_5.4.2_3.0_1724590578974.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_longt5_large_256_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_longt5_large_256_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large_256_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large-256 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_en.md b/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_en.md new file mode 100644 index 00000000000000..a0424a7097f000 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English google_flan_t5_base_imdb T5Transformer from fernandopascualvirue +author: John Snow Labs +name: google_flan_t5_base_imdb +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_flan_t5_base_imdb` is a English model originally trained by fernandopascualvirue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_flan_t5_base_imdb_en_5.4.2_3.0_1724576298380.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_flan_t5_base_imdb_en_5.4.2_3.0_1724576298380.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("google_flan_t5_base_imdb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("google_flan_t5_base_imdb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_flan_t5_base_imdb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fernandopascualvirue/google-flan-t5-base-imdb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_pipeline_en.md new file mode 100644 index 00000000000000..2a3fca3ca3fc4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-google_flan_t5_base_imdb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English google_flan_t5_base_imdb_pipeline pipeline T5Transformer from fernandopascualvirue +author: John Snow Labs +name: google_flan_t5_base_imdb_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_flan_t5_base_imdb_pipeline` is a English model originally trained by fernandopascualvirue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_flan_t5_base_imdb_pipeline_en_5.4.2_3.0_1724576345646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_flan_t5_base_imdb_pipeline_en_5.4.2_3.0_1724576345646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("google_flan_t5_base_imdb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("google_flan_t5_base_imdb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_flan_t5_base_imdb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fernandopascualvirue/google-flan-t5-base-imdb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_en.md b/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_en.md new file mode 100644 index 00000000000000..33f534bc29dd7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_synthesis_small_pszemraj T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_small_pszemraj +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_small_pszemraj` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_small_pszemraj_en_5.4.2_3.0_1724626861754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_small_pszemraj_en_5.4.2_3.0_1724626861754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_synthesis_small_pszemraj","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_synthesis_small_pszemraj", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_small_pszemraj| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.3 MB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_pipeline_en.md new file mode 100644 index 00000000000000..a5e809d2e446ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-grammar_synthesis_small_pszemraj_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_synthesis_small_pszemraj_pipeline pipeline T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_small_pszemraj_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_small_pszemraj_pipeline` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_small_pszemraj_pipeline_en_5.4.2_3.0_1724626880116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_small_pszemraj_pipeline_en_5.4.2_3.0_1724626880116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_synthesis_small_pszemraj_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_synthesis_small_pszemraj_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_small_pszemraj_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.3 MB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-haiz_en.md b/docs/_posts/ahmedlone127/2024-08-25-haiz_en.md new file mode 100644 index 00000000000000..0f839641699681 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-haiz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English haiz T5Transformer from cppmai +author: John Snow Labs +name: haiz +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`haiz` is a English model originally trained by cppmai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/haiz_en_5.4.2_3.0_1724604164353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/haiz_en_5.4.2_3.0_1724604164353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("haiz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("haiz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|haiz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/cppmai/haiz \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-haiz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-haiz_pipeline_en.md new file mode 100644 index 00000000000000..091f835926b585 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-haiz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English haiz_pipeline pipeline T5Transformer from cppmai +author: John Snow Labs +name: haiz_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`haiz_pipeline` is a English model originally trained by cppmai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/haiz_pipeline_en_5.4.2_3.0_1724604224152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/haiz_pipeline_en_5.4.2_3.0_1724604224152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("haiz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("haiz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|haiz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/cppmai/haiz + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_en.md b/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_en.md new file mode 100644 index 00000000000000..8cff04913cfdf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English house_td_t5_small_21 T5Transformer from neal61 +author: John Snow Labs +name: house_td_t5_small_21 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`house_td_t5_small_21` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/house_td_t5_small_21_en_5.4.2_3.0_1724590112573.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/house_td_t5_small_21_en_5.4.2_3.0_1724590112573.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("house_td_t5_small_21","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("house_td_t5_small_21", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|house_td_t5_small_21| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/neal61/house-td-t5-small-21 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_pipeline_en.md new file mode 100644 index 00000000000000..b387276bfe1839 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-house_td_t5_small_21_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English house_td_t5_small_21_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: house_td_t5_small_21_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`house_td_t5_small_21_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/house_td_t5_small_21_pipeline_en_5.4.2_3.0_1724590131142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/house_td_t5_small_21_pipeline_en_5.4.2_3.0_1724590131142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("house_td_t5_small_21_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("house_td_t5_small_21_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|house_td_t5_small_21_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/neal61/house-td-t5-small-21 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_en.md b/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_en.md new file mode 100644 index 00000000000000..cb65ed8d21009b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English idt5_qa_qg_xl T5Transformer from muchad +author: John Snow Labs +name: idt5_qa_qg_xl +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`idt5_qa_qg_xl` is a English model originally trained by muchad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/idt5_qa_qg_xl_en_5.4.2_3.0_1724572236969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/idt5_qa_qg_xl_en_5.4.2_3.0_1724572236969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("idt5_qa_qg_xl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("idt5_qa_qg_xl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|idt5_qa_qg_xl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.9 MB| + +## References + +https://huggingface.co/muchad/idt5-qa-qg-xl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_pipeline_en.md new file mode 100644 index 00000000000000..223c6779718580 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-idt5_qa_qg_xl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English idt5_qa_qg_xl_pipeline pipeline T5Transformer from muchad +author: John Snow Labs +name: idt5_qa_qg_xl_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`idt5_qa_qg_xl_pipeline` is a English model originally trained by muchad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/idt5_qa_qg_xl_pipeline_en_5.4.2_3.0_1724572286334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/idt5_qa_qg_xl_pipeline_en_5.4.2_3.0_1724572286334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("idt5_qa_qg_xl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("idt5_qa_qg_xl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|idt5_qa_qg_xl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.9 MB| + +## References + +https://huggingface.co/muchad/idt5-qa-qg-xl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_en.md new file mode 100644 index 00000000000000..3bfc718a10a25f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English imdb_t5_large_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_large_seed_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_large_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_3_en_5.4.2_3.0_1724622712387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_3_en_5.4.2_3.0_1724622712387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("imdb_t5_large_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("imdb_t5_large_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_large_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-large_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..aab2aa1cec5952 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-imdb_t5_large_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English imdb_t5_large_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_large_seed_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_large_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724622873952.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724622873952.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("imdb_t5_large_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("imdb_t5_large_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_large_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-large_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_en.md b/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_en.md new file mode 100644 index 00000000000000..184d4c3f5b1278 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English impli_t5_e10 T5Transformer from harish +author: John Snow Labs +name: impli_t5_e10 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`impli_t5_e10` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/impli_t5_e10_en_5.4.2_3.0_1724573998315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/impli_t5_e10_en_5.4.2_3.0_1724573998315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("impli_t5_e10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("impli_t5_e10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|impli_t5_e10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|852.3 MB| + +## References + +https://huggingface.co/harish/IMPLI-T5-e10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_pipeline_en.md new file mode 100644 index 00000000000000..3349ecf5c84926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-impli_t5_e10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English impli_t5_e10_pipeline pipeline T5Transformer from harish +author: John Snow Labs +name: impli_t5_e10_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`impli_t5_e10_pipeline` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/impli_t5_e10_pipeline_en_5.4.2_3.0_1724574090545.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/impli_t5_e10_pipeline_en_5.4.2_3.0_1724574090545.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("impli_t5_e10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("impli_t5_e10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|impli_t5_e10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|852.3 MB| + +## References + +https://huggingface.co/harish/IMPLI-T5-e10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_en.md b/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_en.md new file mode 100644 index 00000000000000..1c9a832d2e57a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English intent_classifier T5Transformer from Serj +author: John Snow Labs +name: intent_classifier +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`intent_classifier` is a English model originally trained by Serj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/intent_classifier_en_5.4.2_3.0_1724627562296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/intent_classifier_en_5.4.2_3.0_1724627562296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("intent_classifier","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("intent_classifier", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|intent_classifier| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Serj/intent-classifier \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_pipeline_en.md new file mode 100644 index 00000000000000..8492cf6eb41108 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-intent_classifier_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English intent_classifier_pipeline pipeline T5Transformer from Serj +author: John Snow Labs +name: intent_classifier_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`intent_classifier_pipeline` is a English model originally trained by Serj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/intent_classifier_pipeline_en_5.4.2_3.0_1724627615516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/intent_classifier_pipeline_en_5.4.2_3.0_1724627615516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("intent_classifier_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("intent_classifier_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|intent_classifier_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Serj/intent-classifier + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_en.md new file mode 100644 index 00000000000000..1f7fecda677957 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_aopsl_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aopsl_v5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aopsl_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aopsl_v5_en_5.4.2_3.0_1724622973645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aopsl_v5_en_5.4.2_3.0_1724622973645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_aopsl_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_aopsl_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aopsl_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_AOPSL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_pipeline_en.md new file mode 100644 index 00000000000000..209ba3d87a9709 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_aopsl_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_aopsl_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aopsl_v5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aopsl_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aopsl_v5_pipeline_en_5.4.2_3.0_1724623146471.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aopsl_v5_pipeline_en_5.4.2_3.0_1724623146471.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_aopsl_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_aopsl_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aopsl_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_AOPSL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_en.md new file mode 100644 index 00000000000000..27212feb8295bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_apsol T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_apsol +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_apsol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_en_5.4.2_3.0_1724556856126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_en_5.4.2_3.0_1724556856126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_apsol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_apsol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_apsol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APSOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_pipeline_en.md new file mode 100644 index 00000000000000..71249aec16aff9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_apsol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_apsol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_apsol_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_apsol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_pipeline_en_5.4.2_3.0_1724557027336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_apsol_pipeline_en_5.4.2_3.0_1724557027336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_apsol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_apsol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_apsol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APSOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_en.md new file mode 100644 index 00000000000000..7145262de2c2a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_sopal T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sopal +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sopal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_en_5.4.2_3.0_1724550288543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_en_5.4.2_3.0_1724550288543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_sopal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_sopal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sopal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOPAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_pipeline_en.md new file mode 100644 index 00000000000000..77d1124dfdaf41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_sopal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_sopal_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_sopal_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_sopal_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_pipeline_en_5.4.2_3.0_1724550457905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_sopal_pipeline_en_5.4.2_3.0_1724550457905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_sopal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_sopal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_sopal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOPAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_en.md new file mode 100644 index 00000000000000..f6e705070d2b69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_asopl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_asopl +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_asopl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_en_5.4.2_3.0_1724612983802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_en_5.4.2_3.0_1724612983802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_asopl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_asopl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_asopl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASOPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_pipeline_en.md new file mode 100644 index 00000000000000..b675cc492aadae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_asopl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_asopl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_asopl_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_asopl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_pipeline_en_5.4.2_3.0_1724613156552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_pipeline_en_5.4.2_3.0_1724613156552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_asopl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_asopl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_asopl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASOPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_en.md new file mode 100644 index 00000000000000..645f1aa84c9fe6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_aspol_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_aspol_v5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_aspol_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v5_en_5.4.2_3.0_1724596430477.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v5_en_5.4.2_3.0_1724596430477.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_aspol_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASPOL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_pipeline_en.md new file mode 100644 index 00000000000000..b4a613f8838ca5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_aspol_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_aspol_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_aspol_v5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_aspol_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v5_pipeline_en_5.4.2_3.0_1724596610449.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v5_pipeline_en_5.4.2_3.0_1724596610449.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_aspol_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_aspol_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_aspol_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASPOL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_en.md new file mode 100644 index 00000000000000..dc4a6011bf2654 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_en_5.4.2_3.0_1724558895145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_en_5.4.2_3.0_1724558895145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_5_RS_SE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline_en.md new file mode 100644 index 00000000000000..7e1c715971ed78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline_en_5.4.2_3.0_1724559059070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline_en_5.4.2_3.0_1724559059070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_5_rs_northern_sami_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_5_RS_SE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_en.md new file mode 100644 index 00000000000000..aec3be286f928d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_v5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_v5_en_5.4.2_3.0_1724603065441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_v5_en_5.4.2_3.0_1724603065441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_pipeline_en.md new file mode 100644 index 00000000000000..7d3240dbc5088e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_sapol_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_v5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_v5_pipeline_en_5.4.2_3.0_1724603246158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_v5_pipeline_en_5.4.2_3.0_1724603246158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_sapol_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_sapol_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_en.md new file mode 100644 index 00000000000000..616c1868451ec3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_soapl_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_soapl_v4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_soapl_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v4_en_5.4.2_3.0_1724544508065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v4_en_5.4.2_3.0_1724544508065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_soapl_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_soapl_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_soapl_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SOAPL_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_pipeline_en.md new file mode 100644 index 00000000000000..ceceeec3a9687f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kltn_coqe_vit5_total_soapl_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_soapl_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_soapl_v4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_soapl_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v4_pipeline_en_5.4.2_3.0_1724544678927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v4_pipeline_en_5.4.2_3.0_1724544678927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_soapl_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_soapl_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_soapl_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SOAPL_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_en.md new file mode 100644 index 00000000000000..060f1eaac2372a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kolang_t5_base T5Transformer from digit82 +author: John Snow Labs +name: kolang_t5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kolang_t5_base` is a English model originally trained by digit82. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kolang_t5_base_en_5.4.2_3.0_1724629956031.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kolang_t5_base_en_5.4.2_3.0_1724629956031.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kolang_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kolang_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kolang_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/digit82/kolang-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..02ca1006357f71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-kolang_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kolang_t5_base_pipeline pipeline T5Transformer from digit82 +author: John Snow Labs +name: kolang_t5_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kolang_t5_base_pipeline` is a English model originally trained by digit82. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kolang_t5_base_pipeline_en_5.4.2_3.0_1724630003802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kolang_t5_base_pipeline_en_5.4.2_3.0_1724630003802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kolang_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kolang_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kolang_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/digit82/kolang-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_en.md new file mode 100644 index 00000000000000..f6e310199d53a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_english +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_english_en_5.4.2_3.0_1724607658684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_english_en_5.4.2_3.0_1724607658684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_pipeline_en.md new file mode 100644 index 00000000000000..d8c7a90c230418 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_english_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_english_pipeline_en_5.4.2_3.0_1724607720388.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_english_pipeline_en_5.4.2_3.0_1724607720388.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_finetuned_summ_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_finetuned_summ_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_en.md new file mode 100644 index 00000000000000..9af8810c939aa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_spanish +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_spanish_en_5.4.2_3.0_1724562403449.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_spanish_en_5.4.2_3.0_1724562403449.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_pipeline_en.md new file mode 100644 index 00000000000000..3545d52e8c68da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_finetuned_summ_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_spanish_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_spanish_pipeline_en_5.4.2_3.0_1724562461100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_spanish_pipeline_en_5.4.2_3.0_1724562461100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_finetuned_summ_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_finetuned_summ_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_en.md new file mode 100644 index 00000000000000..fb3a84ae3d3492 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_french +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_french_en_5.4.2_3.0_1724619567728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_french_en_5.4.2_3.0_1724619567728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_pipeline_en.md new file mode 100644 index 00000000000000..471a07be429974 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_summ_multitask_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_french_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_french_pipeline_en_5.4.2_3.0_1724619629507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_french_pipeline_en_5.4.2_3.0_1724619629507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_multitask_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_multitask_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_en.md new file mode 100644 index 00000000000000..01c815886278ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_french_swedish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_swedish +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_swedish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_swedish_en_5.4.2_3.0_1724622001768.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_swedish_en_5.4.2_3.0_1724622001768.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_french_swedish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_french_swedish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_swedish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_sv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_pipeline_en.md new file mode 100644 index 00000000000000..9c04d8336f498c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-legal_t5_small_trans_french_swedish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_french_swedish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_swedish_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_swedish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_swedish_pipeline_en_5.4.2_3.0_1724622062629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_swedish_pipeline_en_5.4.2_3.0_1724622062629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_french_swedish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_french_swedish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_swedish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_sv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_en.md new file mode 100644 index 00000000000000..54c9c2772a3d63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English liputan6_mt5 T5Transformer from alifiaisti +author: John Snow Labs +name: liputan6_mt5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`liputan6_mt5` is a English model originally trained by alifiaisti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/liputan6_mt5_en_5.4.2_3.0_1724559724293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/liputan6_mt5_en_5.4.2_3.0_1724559724293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("liputan6_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("liputan6_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|liputan6_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/alifiaisti/liputan6_mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_pipeline_en.md new file mode 100644 index 00000000000000..291ffa55440610 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-liputan6_mt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English liputan6_mt5_pipeline pipeline T5Transformer from alifiaisti +author: John Snow Labs +name: liputan6_mt5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`liputan6_mt5_pipeline` is a English model originally trained by alifiaisti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/liputan6_mt5_pipeline_en_5.4.2_3.0_1724560003277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/liputan6_mt5_pipeline_en_5.4.2_3.0_1724560003277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("liputan6_mt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("liputan6_mt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|liputan6_mt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/alifiaisti/liputan6_mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_en.md new file mode 100644 index 00000000000000..ccc22d8b08447c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English llmnids_t5small_1 T5Transformer from tali1 +author: John Snow Labs +name: llmnids_t5small_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`llmnids_t5small_1` is a English model originally trained by tali1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/llmnids_t5small_1_en_5.4.2_3.0_1724611158013.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/llmnids_t5small_1_en_5.4.2_3.0_1724611158013.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("llmnids_t5small_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("llmnids_t5small_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|llmnids_t5small_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/tali1/LLMNIDS-t5small-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_pipeline_en.md new file mode 100644 index 00000000000000..3e66f81856d5e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-llmnids_t5small_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English llmnids_t5small_1_pipeline pipeline T5Transformer from tali1 +author: John Snow Labs +name: llmnids_t5small_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`llmnids_t5small_1_pipeline` is a English model originally trained by tali1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/llmnids_t5small_1_pipeline_en_5.4.2_3.0_1724611182561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/llmnids_t5small_1_pipeline_en_5.4.2_3.0_1724611182561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("llmnids_t5small_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("llmnids_t5small_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|llmnids_t5small_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/tali1/LLMNIDS-t5small-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_en.md new file mode 100644 index 00000000000000..2b2276a53ea627 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lomonosov_small_v1 T5Transformer from NikitaKukuzey +author: John Snow Labs +name: lomonosov_small_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lomonosov_small_v1` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lomonosov_small_v1_en_5.4.2_3.0_1724579099945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lomonosov_small_v1_en_5.4.2_3.0_1724579099945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lomonosov_small_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lomonosov_small_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lomonosov_small_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.0 MB| + +## References + +https://huggingface.co/NikitaKukuzey/Lomonosov_small_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_pipeline_en.md new file mode 100644 index 00000000000000..d4503dd4132690 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-lomonosov_small_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lomonosov_small_v1_pipeline pipeline T5Transformer from NikitaKukuzey +author: John Snow Labs +name: lomonosov_small_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lomonosov_small_v1_pipeline` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lomonosov_small_v1_pipeline_en_5.4.2_3.0_1724579126338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lomonosov_small_v1_pipeline_en_5.4.2_3.0_1724579126338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lomonosov_small_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lomonosov_small_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lomonosov_small_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.0 MB| + +## References + +https://huggingface.co/NikitaKukuzey/Lomonosov_small_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_en.md b/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_en.md new file mode 100644 index 00000000000000..13819f16082898 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lora_flan_t5_large_chuvash_chatbot T5Transformer from saadrasheeddev +author: John Snow Labs +name: lora_flan_t5_large_chuvash_chatbot +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lora_flan_t5_large_chuvash_chatbot` is a English model originally trained by saadrasheeddev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lora_flan_t5_large_chuvash_chatbot_en_5.4.2_3.0_1724619128441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lora_flan_t5_large_chuvash_chatbot_en_5.4.2_3.0_1724619128441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lora_flan_t5_large_chuvash_chatbot","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lora_flan_t5_large_chuvash_chatbot", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lora_flan_t5_large_chuvash_chatbot| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/saadrasheeddev/lora-flan-t5-large-cv_chatbot \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_pipeline_en.md new file mode 100644 index 00000000000000..d573f2d10978d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-lora_flan_t5_large_chuvash_chatbot_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lora_flan_t5_large_chuvash_chatbot_pipeline pipeline T5Transformer from saadrasheeddev +author: John Snow Labs +name: lora_flan_t5_large_chuvash_chatbot_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lora_flan_t5_large_chuvash_chatbot_pipeline` is a English model originally trained by saadrasheeddev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lora_flan_t5_large_chuvash_chatbot_pipeline_en_5.4.2_3.0_1724619272594.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lora_flan_t5_large_chuvash_chatbot_pipeline_en_5.4.2_3.0_1724619272594.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lora_flan_t5_large_chuvash_chatbot_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lora_flan_t5_large_chuvash_chatbot_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lora_flan_t5_large_chuvash_chatbot_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/saadrasheeddev/lora-flan-t5-large-cv_chatbot + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-low3_en.md b/docs/_posts/ahmedlone127/2024-08-25-low3_en.md new file mode 100644 index 00000000000000..535004e522f5aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-low3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low3 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low3` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low3_en_5.4.2_3.0_1724556297805.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low3_en_5.4.2_3.0_1724556297805.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.1 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-low3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-low3_pipeline_en.md new file mode 100644 index 00000000000000..5ba48dba96a33d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-low3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low3_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low3_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low3_pipeline_en_5.4.2_3.0_1724556353843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low3_pipeline_en_5.4.2_3.0_1724556353843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.1 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-low7_en.md b/docs/_posts/ahmedlone127/2024-08-25-low7_en.md new file mode 100644 index 00000000000000..1fb48c3e855390 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-low7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low7 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low7 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low7` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low7_en_5.4.2_3.0_1724602700033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low7_en_5.4.2_3.0_1724602700033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.2 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-low7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-low7_pipeline_en.md new file mode 100644 index 00000000000000..43a4db3e667a28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-low7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low7_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low7_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low7_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low7_pipeline_en_5.4.2_3.0_1724602757071.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low7_pipeline_en_5.4.2_3.0_1724602757071.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.2 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_en.md new file mode 100644 index 00000000000000..27b0fa8ec721e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English m_t5_base_v1 T5Transformer from Mrf01 +author: John Snow Labs +name: m_t5_base_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`m_t5_base_v1` is a English model originally trained by Mrf01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/m_t5_base_v1_en_5.4.2_3.0_1724562827659.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/m_t5_base_v1_en_5.4.2_3.0_1724562827659.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("m_t5_base_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("m_t5_base_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|m_t5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/Mrf01/m-t5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_pipeline_en.md new file mode 100644 index 00000000000000..7589556dd3d024 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-m_t5_base_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English m_t5_base_v1_pipeline pipeline T5Transformer from Mrf01 +author: John Snow Labs +name: m_t5_base_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`m_t5_base_v1_pipeline` is a English model originally trained by Mrf01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/m_t5_base_v1_pipeline_en_5.4.2_3.0_1724563145738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/m_t5_base_v1_pipeline_en_5.4.2_3.0_1724563145738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("m_t5_base_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("m_t5_base_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|m_t5_base_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/Mrf01/m-t5-base-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mcq_en.md b/docs/_posts/ahmedlone127/2024-08-25-mcq_en.md new file mode 100644 index 00000000000000..8ed253cc752c24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mcq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mcq T5Transformer from Nikhil2904 +author: John Snow Labs +name: mcq +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mcq` is a English model originally trained by Nikhil2904. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mcq_en_5.4.2_3.0_1724624929584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mcq_en_5.4.2_3.0_1724624929584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mcq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mcq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mcq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.5 MB| + +## References + +https://huggingface.co/Nikhil2904/mcq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mcq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mcq_pipeline_en.md new file mode 100644 index 00000000000000..dd9714489272fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mcq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mcq_pipeline pipeline T5Transformer from Nikhil2904 +author: John Snow Labs +name: mcq_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mcq_pipeline` is a English model originally trained by Nikhil2904. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mcq_pipeline_en_5.4.2_3.0_1724624949838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mcq_pipeline_en_5.4.2_3.0_1724624949838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mcq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mcq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mcq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.5 MB| + +## References + +https://huggingface.co/Nikhil2904/mcq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_en.md b/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_en.md new file mode 100644 index 00000000000000..5a3d6f1d18740f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mcq_squad_own T5Transformer from nikhilshetty +author: John Snow Labs +name: mcq_squad_own +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mcq_squad_own` is a English model originally trained by nikhilshetty. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mcq_squad_own_en_5.4.2_3.0_1724613899080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mcq_squad_own_en_5.4.2_3.0_1724613899080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mcq_squad_own","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mcq_squad_own", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mcq_squad_own| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nikhilshetty/mcq_squad_own \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_pipeline_en.md new file mode 100644 index 00000000000000..a61aec0f627f5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mcq_squad_own_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mcq_squad_own_pipeline pipeline T5Transformer from nikhilshetty +author: John Snow Labs +name: mcq_squad_own_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mcq_squad_own_pipeline` is a English model originally trained by nikhilshetty. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mcq_squad_own_pipeline_en_5.4.2_3.0_1724613948434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mcq_squad_own_pipeline_en_5.4.2_3.0_1724613948434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mcq_squad_own_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mcq_squad_own_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mcq_squad_own_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nikhilshetty/mcq_squad_own + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_en.md b/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_en.md new file mode 100644 index 00000000000000..ee5d5f8ac5107d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English md_mt5_0109_v4 T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_0109_v4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_0109_v4` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_0109_v4_en_5.4.2_3.0_1724601534922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_0109_v4_en_5.4.2_3.0_1724601534922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("md_mt5_0109_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("md_mt5_0109_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_0109_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_0109_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_pipeline_en.md new file mode 100644 index 00000000000000..fcec496336d327 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-md_mt5_0109_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English md_mt5_0109_v4_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_0109_v4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_0109_v4_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_0109_v4_pipeline_en_5.4.2_3.0_1724601684820.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_0109_v4_pipeline_en_5.4.2_3.0_1724601684820.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("md_mt5_0109_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("md_mt5_0109_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_0109_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_0109_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_en.md b/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_en.md new file mode 100644 index 00000000000000..dea674c0ef9a14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000 T5Transformer from sitongz +author: John Snow Labs +name: medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000` is a English model originally trained by sitongz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_en_5.4.2_3.0_1724596242411.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_en_5.4.2_3.0_1724596242411.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|933.7 MB| + +## References + +https://huggingface.co/sitongz/medqa_taskB_t5-base_seq_synthetic_onl-checkpoint-11000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline_en.md new file mode 100644 index 00000000000000..15b8e75f97fb4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline pipeline T5Transformer from sitongz +author: John Snow Labs +name: medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline` is a English model originally trained by sitongz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline_en_5.4.2_3.0_1724596295568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline_en_5.4.2_3.0_1724596295568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|medqa_taskb_t5_base_seq_synthetic_onl_checkpoint_11000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|933.7 MB| + +## References + +https://huggingface.co/sitongz/medqa_taskB_t5-base_seq_synthetic_onl-checkpoint-11000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-metadata_en.md b/docs/_posts/ahmedlone127/2024-08-25-metadata_en.md new file mode 100644 index 00000000000000..c786d1ba592859 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-metadata_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English metadata T5Transformer from ademax +author: John Snow Labs +name: metadata +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`metadata` is a English model originally trained by ademax. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/metadata_en_5.4.2_3.0_1724546330518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/metadata_en_5.4.2_3.0_1724546330518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("metadata","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("metadata", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|metadata| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|660.9 MB| + +## References + +https://huggingface.co/ademax/metadata \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-metadata_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-metadata_pipeline_en.md new file mode 100644 index 00000000000000..ad9129e697a1de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-metadata_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English metadata_pipeline pipeline T5Transformer from ademax +author: John Snow Labs +name: metadata_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`metadata_pipeline` is a English model originally trained by ademax. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/metadata_pipeline_en_5.4.2_3.0_1724546522550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/metadata_pipeline_en_5.4.2_3.0_1724546522550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("metadata_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("metadata_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|metadata_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|660.9 MB| + +## References + +https://huggingface.co/ademax/metadata + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_en.md new file mode 100644 index 00000000000000..503b532034100f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mia_t5_v1_1_large T5Transformer from aarunsrinivas +author: John Snow Labs +name: mia_t5_v1_1_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mia_t5_v1_1_large` is a English model originally trained by aarunsrinivas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mia_t5_v1_1_large_en_5.4.2_3.0_1724552701732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mia_t5_v1_1_large_en_5.4.2_3.0_1724552701732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mia_t5_v1_1_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mia_t5_v1_1_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mia_t5_v1_1_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/aarunsrinivas/mia-t5-v1_1-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_pipeline_en.md new file mode 100644 index 00000000000000..648b9caf66ed69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mia_t5_v1_1_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mia_t5_v1_1_large_pipeline pipeline T5Transformer from aarunsrinivas +author: John Snow Labs +name: mia_t5_v1_1_large_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mia_t5_v1_1_large_pipeline` is a English model originally trained by aarunsrinivas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mia_t5_v1_1_large_pipeline_en_5.4.2_3.0_1724552842271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mia_t5_v1_1_large_pipeline_en_5.4.2_3.0_1724552842271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mia_t5_v1_1_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mia_t5_v1_1_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mia_t5_v1_1_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/aarunsrinivas/mia-t5-v1_1-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_en.md new file mode 100644 index 00000000000000..6728be61d179ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mnli_t5_base_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_base_seed_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_base_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_1_en_5.4.2_3.0_1724626311986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_1_en_5.4.2_3.0_1724626311986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mnli_t5_base_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mnli_t5_base_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_base_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.3 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-base_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..f1c3e0d5e597a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mnli_t5_base_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mnli_t5_base_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_base_seed_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_base_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724626367978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724626367978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mnli_t5_base_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mnli_t5_base_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_base_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.3 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-base_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_en.md b/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_en.md new file mode 100644 index 00000000000000..bc1b07a19659bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English model_gaoweic T5Transformer from gaoweic +author: John Snow Labs +name: model_gaoweic +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_gaoweic` is a English model originally trained by gaoweic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_gaoweic_en_5.4.2_3.0_1724549269861.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_gaoweic_en_5.4.2_3.0_1724549269861.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("model_gaoweic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("model_gaoweic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_gaoweic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/gaoweic/Model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_pipeline_en.md new file mode 100644 index 00000000000000..b8cf33ea2cb084 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-model_gaoweic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English model_gaoweic_pipeline pipeline T5Transformer from gaoweic +author: John Snow Labs +name: model_gaoweic_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_gaoweic_pipeline` is a English model originally trained by gaoweic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_gaoweic_pipeline_en_5.4.2_3.0_1724549288016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_gaoweic_pipeline_en_5.4.2_3.0_1724549288016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("model_gaoweic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("model_gaoweic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_gaoweic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/gaoweic/Model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_en.md b/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_en.md new file mode 100644 index 00000000000000..2a326541ace3b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English monot5_small_msmarco_100k T5Transformer from castorini +author: John Snow Labs +name: monot5_small_msmarco_100k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`monot5_small_msmarco_100k` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/monot5_small_msmarco_100k_en_5.4.2_3.0_1724561892493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/monot5_small_msmarco_100k_en_5.4.2_3.0_1724561892493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("monot5_small_msmarco_100k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("monot5_small_msmarco_100k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|monot5_small_msmarco_100k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/castorini/monot5-small-msmarco-100k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_pipeline_en.md new file mode 100644 index 00000000000000..75960f938f5a43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-monot5_small_msmarco_100k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English monot5_small_msmarco_100k_pipeline pipeline T5Transformer from castorini +author: John Snow Labs +name: monot5_small_msmarco_100k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`monot5_small_msmarco_100k_pipeline` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/monot5_small_msmarco_100k_pipeline_en_5.4.2_3.0_1724561953039.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/monot5_small_msmarco_100k_pipeline_en_5.4.2_3.0_1724561953039.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("monot5_small_msmarco_100k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("monot5_small_msmarco_100k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|monot5_small_msmarco_100k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/castorini/monot5-small-msmarco-100k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_en.md new file mode 100644 index 00000000000000..83b2c8b08fd5cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_dequad_qg_trimmed_45000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_dequad_qg_trimmed_45000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qg_trimmed_45000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_45000_en_5.4.2_3.0_1724611450640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_45000_en_5.4.2_3.0_1724611450640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_dequad_qg_trimmed_45000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_dequad_qg_trimmed_45000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qg_trimmed_45000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-dequad-qg-trimmed-45000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_pipeline_en.md new file mode 100644 index 00000000000000..68a87f3d243e1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_dequad_qg_trimmed_45000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_dequad_qg_trimmed_45000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_dequad_qg_trimmed_45000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qg_trimmed_45000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_45000_pipeline_en_5.4.2_3.0_1724611504723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_45000_pipeline_en_5.4.2_3.0_1724611504723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_dequad_qg_trimmed_45000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_dequad_qg_trimmed_45000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qg_trimmed_45000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-dequad-qg-trimmed-45000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_en.md new file mode 100644 index 00000000000000..d559d2d0deec3e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_fayez94 T5Transformer from fayez94 +author: John Snow Labs +name: mt5_base_fayez94 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_fayez94` is a English model originally trained by fayez94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_fayez94_en_5.4.2_3.0_1724555746056.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_fayez94_en_5.4.2_3.0_1724555746056.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_fayez94","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_fayez94", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_fayez94| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/fayez94/mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_pipeline_en.md new file mode 100644 index 00000000000000..8a6cbe8724ab3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_fayez94_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_fayez94_pipeline pipeline T5Transformer from fayez94 +author: John Snow Labs +name: mt5_base_fayez94_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_fayez94_pipeline` is a English model originally trained by fayez94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_fayez94_pipeline_en_5.4.2_3.0_1724555839705.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_fayez94_pipeline_en_5.4.2_3.0_1724555839705.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_fayez94_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_fayez94_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_fayez94_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/fayez94/mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_en.md new file mode 100644 index 00000000000000..932e1dfaf33837 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_deplain T5Transformer from jonathandechert +author: John Snow Labs +name: mt5_base_finetuned_deplain +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_deplain` is a English model originally trained by jonathandechert. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_deplain_en_5.4.2_3.0_1724573991985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_deplain_en_5.4.2_3.0_1724573991985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_deplain","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_deplain", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_deplain| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/jonathandechert/mt5-base-finetuned-DEPlain \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_pipeline_en.md new file mode 100644 index 00000000000000..f4b740bdc2cf76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_deplain_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_deplain_pipeline pipeline T5Transformer from jonathandechert +author: John Snow Labs +name: mt5_base_finetuned_deplain_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_deplain_pipeline` is a English model originally trained by jonathandechert. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_deplain_pipeline_en_5.4.2_3.0_1724574242789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_deplain_pipeline_en_5.4.2_3.0_1724574242789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_deplain_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_deplain_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_deplain_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/jonathandechert/mt5-base-finetuned-DEPlain + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_en.md new file mode 100644 index 00000000000000..33884e4394105e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_en_5.4.2_3.0_1724620014847.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_en_5.4.2_3.0_1724620014847.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-base-finetuned-kk-to-en-cold-burger \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline_en.md new file mode 100644 index 00000000000000..9614ba00fc3938 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline pipeline T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline_en_5.4.2_3.0_1724620511209.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline_en_5.4.2_3.0_1724620511209.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_kazakh_tonga_tonga_islands_english_cold_burger_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-base-finetuned-kk-to-en-cold-burger + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_en.md new file mode 100644 index 00000000000000..d2ca326af50cf9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_summarization_v2 T5Transformer from GiordanoB +author: John Snow Labs +name: mt5_base_finetuned_summarization_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_summarization_v2` is a English model originally trained by GiordanoB. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_summarization_v2_en_5.4.2_3.0_1724622152794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_summarization_v2_en_5.4.2_3.0_1724622152794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_summarization_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_summarization_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_summarization_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.0 GB| + +## References + +https://huggingface.co/GiordanoB/mt5-base-finetuned-summarization-V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_pipeline_en.md new file mode 100644 index 00000000000000..2ac62d6e96c7cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_summarization_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_summarization_v2_pipeline pipeline T5Transformer from GiordanoB +author: John Snow Labs +name: mt5_base_finetuned_summarization_v2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_summarization_v2_pipeline` is a English model originally trained by GiordanoB. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_summarization_v2_pipeline_en_5.4.2_3.0_1724622390615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_summarization_v2_pipeline_en_5.4.2_3.0_1724622390615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_summarization_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_summarization_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_summarization_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.0 GB| + +## References + +https://huggingface.co/GiordanoB/mt5-base-finetuned-summarization-V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base_en.md new file mode 100644 index 00000000000000..00455bd75589c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724550548988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724550548988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_data_prep_2021_12_26___t1_162754_csv___topic_text_google_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-data_prep_2021_12_26___t1_162754.csv___topic_text_google_mt5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..848302764bff6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_frquad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_frquad_qag_trimmed_50000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qag_trimmed_50000_en_5.4.2_3.0_1724593092499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qag_trimmed_50000_en_5.4.2_3.0_1724593092499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_frquad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_frquad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-frquad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..2950cabf63e81e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_frquad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_frquad_qag_trimmed_50000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724593148544.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724593148544.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-frquad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_en.md new file mode 100644 index 00000000000000..458549cd3949af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_15000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_15000_en_5.4.2_3.0_1724613996482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_15000_en_5.4.2_3.0_1724613996482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|867.9 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_pipeline_en.md new file mode 100644 index 00000000000000..eef81f76d3b16a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_frquad_qg_trimmed_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_15000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724614039963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724614039963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_qg_trimmed_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_qg_trimmed_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|867.9 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_mrf01_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_mrf01_en.md new file mode 100644 index 00000000000000..69925dbe47cc2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_mrf01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_mrf01 T5Transformer from Mrf01 +author: John Snow Labs +name: mt5_base_mrf01 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_mrf01` is a English model originally trained by Mrf01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_mrf01_en_5.4.2_3.0_1724574181640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_mrf01_en_5.4.2_3.0_1724574181640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_mrf01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_mrf01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_mrf01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/Mrf01/mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_en.md new file mode 100644 index 00000000000000..d96deca06cbb22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_2k_deen T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_deen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_deen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_deen_en_5.4.2_3.0_1724588255077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_deen_en_5.4.2_3.0_1724588255077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_2k_deen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_2k_deen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_deen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-deen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_pipeline_en.md new file mode 100644 index 00000000000000..c9c103b0d8e956 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_2k_deen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_2k_deen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_deen_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_deen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_deen_pipeline_en_5.4.2_3.0_1724588569633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_deen_pipeline_en_5.4.2_3.0_1724588569633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_2k_deen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_2k_deen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_deen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-deen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_en.md new file mode 100644 index 00000000000000..377632b62b2721 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_50k_ende T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_50k_ende +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_50k_ende` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ende_en_5.4.2_3.0_1724610366699.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ende_en_5.4.2_3.0_1724610366699.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_50k_ende","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_50k_ende", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_50k_ende| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-50k-ende \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_pipeline_en.md new file mode 100644 index 00000000000000..c29416b3859754 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_nc16_50k_ende_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_50k_ende_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_50k_ende_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_50k_ende_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ende_pipeline_en_5.4.2_3.0_1724610646619.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ende_pipeline_en_5.4.2_3.0_1724610646619.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_50k_ende_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_50k_ende_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_50k_ende_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-50k-ende + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_ae_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_ae_pipeline_ru.md new file mode 100644 index 00000000000000..60a0dcb09f04b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_ae_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_base_ruquad_qg_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_ruquad_qg_ae_pipeline +date: 2024-08-25 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_ae_pipeline` is a Russian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_pipeline_ru_5.4.2_3.0_1724565197902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_pipeline_ru_5.4.2_3.0_1724565197902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ruquad_qg_ae_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ruquad_qg_ae_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|2.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-ruquad-qg-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_en.md new file mode 100644 index 00000000000000..2171c392596aca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_trimmed_30000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_ruquad_qg_trimmed_30000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_trimmed_30000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_30000_en_5.4.2_3.0_1724597595264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_30000_en_5.4.2_3.0_1724597595264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_trimmed_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_trimmed_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_trimmed_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|984.9 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-ruquad-qg-trimmed-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_pipeline_en.md new file mode 100644 index 00000000000000..a0eeaea3371e8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_ruquad_qg_trimmed_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_trimmed_30000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_ruquad_qg_trimmed_30000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_trimmed_30000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724597642151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724597642151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ruquad_qg_trimmed_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ruquad_qg_trimmed_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_trimmed_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.0 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-ruquad-qg-trimmed-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_thai_multiple_e2e_qg_aug_numsep_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_thai_multiple_e2e_qg_aug_numsep_v2_en.md new file mode 100644 index 00000000000000..e4eb0bdd9037bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_thai_multiple_e2e_qg_aug_numsep_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_thai_multiple_e2e_qg_aug_numsep_v2 T5Transformer from parinzee +author: John Snow Labs +name: mt5_base_thai_multiple_e2e_qg_aug_numsep_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_thai_multiple_e2e_qg_aug_numsep_v2` is a English model originally trained by parinzee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_thai_multiple_e2e_qg_aug_numsep_v2_en_5.4.2_3.0_1724549302474.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_thai_multiple_e2e_qg_aug_numsep_v2_en_5.4.2_3.0_1724549302474.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_thai_multiple_e2e_qg_aug_numsep_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_thai_multiple_e2e_qg_aug_numsep_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_thai_multiple_e2e_qg_aug_numsep_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/parinzee/mt5-base-thai-multiple-e2e-qg-aug-numsep-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_translation_english_tonga_tonga_islands_persian_farsi_fa.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_translation_english_tonga_tonga_islands_persian_farsi_fa.md new file mode 100644 index 00000000000000..c2f55c07e4c49e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_translation_english_tonga_tonga_islands_persian_farsi_fa.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Persian mt5_base_translation_english_tonga_tonga_islands_persian_farsi T5Transformer from NLPclass +author: John Snow Labs +name: mt5_base_translation_english_tonga_tonga_islands_persian_farsi +date: 2024-08-25 +tags: [fa, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fa +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_translation_english_tonga_tonga_islands_persian_farsi` is a Persian model originally trained by NLPclass. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_translation_english_tonga_tonga_islands_persian_farsi_fa_5.4.2_3.0_1724592768395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_translation_english_tonga_tonga_islands_persian_farsi_fa_5.4.2_3.0_1724592768395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_translation_english_tonga_tonga_islands_persian_farsi","fa") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_translation_english_tonga_tonga_islands_persian_farsi", "fa") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_translation_english_tonga_tonga_islands_persian_farsi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fa| +|Size:|2.3 GB| + +## References + +https://huggingface.co/NLPclass/mt5_base_translation_en_to_fa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_en.md new file mode 100644 index 00000000000000..d82ea366050610 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_french_45000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_45000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_45000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_45000_en_5.4.2_3.0_1724602732875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_45000_en_5.4.2_3.0_1724602732875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_french_45000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_french_45000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_45000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|579.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-45000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_pipeline_en.md new file mode 100644 index 00000000000000..84f6a1307185a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_45000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_french_45000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_45000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_45000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_45000_pipeline_en_5.4.2_3.0_1724602934088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_45000_pipeline_en_5.4.2_3.0_1724602934088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_french_45000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_french_45000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_45000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|579.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-45000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_en.md new file mode 100644 index 00000000000000..4673ef9b34c3c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_french_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_75000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_75000_en_5.4.2_3.0_1724570084157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_75000_en_5.4.2_3.0_1724570084157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_french_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_french_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_pipeline_en.md new file mode 100644 index 00000000000000..6cb97249919754 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_french_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_french_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_75000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_75000_pipeline_en_5.4.2_3.0_1724570325631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_75000_pipeline_en_5.4.2_3.0_1724570325631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_french_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_french_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_en.md new file mode 100644 index 00000000000000..98239d736686d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_german_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_15000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_en_5.4.2_3.0_1724590282037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_en_5.4.2_3.0_1724590282037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_pipeline_en.md new file mode 100644 index 00000000000000..8a2b0dd31643ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_german_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_german_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_15000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_pipeline_en_5.4.2_3.0_1724590435431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_pipeline_en_5.4.2_3.0_1724590435431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_en.md new file mode 100644 index 00000000000000..da048300084839 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_30000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_30000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_30000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_30000_en_5.4.2_3.0_1724552243131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_30000_en_5.4.2_3.0_1724552243131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|513.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_pipeline_en.md new file mode 100644 index 00000000000000..f0493882d4f403 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_italian_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_30000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_30000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_30000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_30000_pipeline_en_5.4.2_3.0_1724552418877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_30000_pipeline_en_5.4.2_3.0_1724552418877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_italian_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_italian_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|513.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_en.md new file mode 100644 index 00000000000000..f6f8c2f8b7c901 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_korean_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_korean_15000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_korean_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_15000_en_5.4.2_3.0_1724544086084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_15000_en_5.4.2_3.0_1724544086084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_korean_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_korean_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_korean_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ko-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_pipeline_en.md new file mode 100644 index 00000000000000..abe92962021333 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_korean_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_korean_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_korean_15000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_korean_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724544235893.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724544235893.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_korean_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_korean_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_korean_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ko-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_en.md new file mode 100644 index 00000000000000..53bfcbb30977cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_120000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_120000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_120000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_120000_en_5.4.2_3.0_1724619019411.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_120000_en_5.4.2_3.0_1724619019411.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|909.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_pipeline_en.md new file mode 100644 index 00000000000000..9798c07ba6cafd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_base_trimmed_spanish_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_120000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_120000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_120000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_120000_pipeline_en_5.4.2_3.0_1724619336951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_120000_pipeline_en_5.4.2_3.0_1724619336951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_spanish_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_spanish_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|909.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_en.md new file mode 100644 index 00000000000000..c07b78b6a5bce0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_cctk T5Transformer from tharindu +author: John Snow Labs +name: mt5_cctk +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_cctk` is a English model originally trained by tharindu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_cctk_en_5.4.2_3.0_1724546257223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_cctk_en_5.4.2_3.0_1724546257223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_cctk","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_cctk", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_cctk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/tharindu/mt5_cctk \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_pipeline_en.md new file mode 100644 index 00000000000000..674913a1f2054a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_cctk_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_cctk_pipeline pipeline T5Transformer from tharindu +author: John Snow Labs +name: mt5_cctk_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_cctk_pipeline` is a English model originally trained by tharindu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_cctk_pipeline_en_5.4.2_3.0_1724546500687.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_cctk_pipeline_en_5.4.2_3.0_1724546500687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_cctk_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_cctk_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_cctk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/tharindu/mt5_cctk + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_en.md new file mode 100644 index 00000000000000..a180b5bc782a1c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_perisan_translation2en T5Transformer from AidAFadaeian +author: John Snow Labs +name: mt5_perisan_translation2en +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_perisan_translation2en` is a English model originally trained by AidAFadaeian. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_perisan_translation2en_en_5.4.2_3.0_1724598941788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_perisan_translation2en_en_5.4.2_3.0_1724598941788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_perisan_translation2en","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_perisan_translation2en", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_perisan_translation2en| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/AidAFadaeian/Mt5_perisan_translation2En \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_pipeline_en.md new file mode 100644 index 00000000000000..088ea147ee0afb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_perisan_translation2en_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_perisan_translation2en_pipeline pipeline T5Transformer from AidAFadaeian +author: John Snow Labs +name: mt5_perisan_translation2en_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_perisan_translation2en_pipeline` is a English model originally trained by AidAFadaeian. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_perisan_translation2en_pipeline_en_5.4.2_3.0_1724599242426.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_perisan_translation2en_pipeline_en_5.4.2_3.0_1724599242426.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_perisan_translation2en_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_perisan_translation2en_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_perisan_translation2en_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/AidAFadaeian/Mt5_perisan_translation2En + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_en.md new file mode 100644 index 00000000000000..3787a70485643f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_assamese_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_assamese_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_assamese_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_assamese_10k_en_5.4.2_3.0_1724586482422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_assamese_10k_en_5.4.2_3.0_1724586482422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_assamese_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_assamese_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_assamese_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-as-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_pipeline_en.md new file mode 100644 index 00000000000000..4dbe09e1ada9fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_assamese_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_assamese_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_assamese_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_assamese_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_assamese_10k_pipeline_en_5.4.2_3.0_1724586643643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_assamese_10k_pipeline_en_5.4.2_3.0_1724586643643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_assamese_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_assamese_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_assamese_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-as-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_en.md new file mode 100644 index 00000000000000..14b824d8422357 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ckb_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_ckb_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ckb_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ckb_10k_en_5.4.2_3.0_1724617784112.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ckb_10k_en_5.4.2_3.0_1724617784112.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ckb_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ckb_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ckb_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ckb-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_pipeline_en.md new file mode 100644 index 00000000000000..14f1b83e98f67f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_ckb_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ckb_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_ckb_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ckb_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ckb_10k_pipeline_en_5.4.2_3.0_1724617957520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ckb_10k_pipeline_en_5.4.2_3.0_1724617957520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ckb_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ckb_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ckb_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ckb-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_en.md new file mode 100644 index 00000000000000..eaa397150174ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_en_5.4.2_3.0_1724552958737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_en_5.4.2_3.0_1724552958737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|790.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_pipeline_en.md new file mode 100644 index 00000000000000..bb6bfb138632e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qa_trimmed_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_pipeline_en_5.4.2_3.0_1724553006667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_pipeline_en_5.4.2_3.0_1724553006667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|790.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_en.md new file mode 100644 index 00000000000000..d8322c565cc9a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qg_trimmed_spanish_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qg_trimmed_spanish_60000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_trimmed_spanish_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_60000_en_5.4.2_3.0_1724617385831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_60000_en_5.4.2_3.0_1724617385831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qg_trimmed_spanish_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qg_trimmed_spanish_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_trimmed_spanish_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|482.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qg-trimmed-es-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_pipeline_en.md new file mode 100644 index 00000000000000..72a029ba8f2106 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_esquad_qg_trimmed_spanish_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qg_trimmed_spanish_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qg_trimmed_spanish_60000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qg_trimmed_spanish_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_60000_pipeline_en_5.4.2_3.0_1724617410792.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qg_trimmed_spanish_60000_pipeline_en_5.4.2_3.0_1724617410792.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qg_trimmed_spanish_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qg_trimmed_spanish_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qg_trimmed_spanish_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|482.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qg-trimmed-es-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_en.md new file mode 100644 index 00000000000000..735e600c746981 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_25feb_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_25feb_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_25feb_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_1_en_5.4.2_3.0_1724606878783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_1_en_5.4.2_3.0_1724606878783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_25feb_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_25feb_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_25feb_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-25feb-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_pipeline_en.md new file mode 100644 index 00000000000000..df911eea19ec33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_25feb_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_25feb_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_25feb_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_25feb_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_1_pipeline_en_5.4.2_3.0_1724606974655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_1_pipeline_en_5.4.2_3.0_1724606974655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_25feb_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_25feb_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_25feb_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-25feb-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_en.md new file mode 100644 index 00000000000000..13ee5d6b7b5038 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_physhunter T5Transformer from PhysHunter +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_physhunter +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_physhunter` is a English model originally trained by PhysHunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_physhunter_en_5.4.2_3.0_1724598933019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_physhunter_en_5.4.2_3.0_1724598933019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_physhunter","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_physhunter", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_physhunter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PhysHunter/mt5-small-finetuned-amazon-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_pipeline_en.md new file mode 100644 index 00000000000000..af0c8cd1f5b821 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_physhunter_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_physhunter_pipeline pipeline T5Transformer from PhysHunter +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_physhunter_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_physhunter_pipeline` is a English model originally trained by PhysHunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_physhunter_pipeline_en_5.4.2_3.0_1724599031316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_physhunter_pipeline_en_5.4.2_3.0_1724599031316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_physhunter_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_physhunter_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_physhunter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PhysHunter/mt5-small-finetuned-amazon-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_en.md new file mode 100644 index 00000000000000..c1b65425ce4502 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_audi24 T5Transformer from Audi24 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_audi24 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_audi24` is a English model originally trained by Audi24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_audi24_en_5.4.2_3.0_1724601280860.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_audi24_en_5.4.2_3.0_1724601280860.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_audi24","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_audi24", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_audi24| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Audi24/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_pipeline_en.md new file mode 100644 index 00000000000000..53c7f6b50a2239 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_audi24_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_audi24_pipeline pipeline T5Transformer from Audi24 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_audi24_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_audi24_pipeline` is a English model originally trained by Audi24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_audi24_pipeline_en_5.4.2_3.0_1724601375927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_audi24_pipeline_en_5.4.2_3.0_1724601375927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_audi24_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_audi24_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_audi24_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Audi24/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_en.md new file mode 100644 index 00000000000000..64dcf8f20c27fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_dariga T5Transformer from dariga +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_dariga +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_dariga` is a English model originally trained by dariga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dariga_en_5.4.2_3.0_1724583170666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dariga_en_5.4.2_3.0_1724583170666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_dariga","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_dariga", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_dariga| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dariga/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_pipeline_en.md new file mode 100644 index 00000000000000..862a506eb6743f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_dariga_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_dariga_pipeline pipeline T5Transformer from dariga +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_dariga_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_dariga_pipeline` is a English model originally trained by dariga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dariga_pipeline_en_5.4.2_3.0_1724583266792.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dariga_pipeline_en_5.4.2_3.0_1724583266792.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_dariga_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_dariga_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_dariga_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dariga/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_en.md new file mode 100644 index 00000000000000..b592fa97e651dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hey7ys T5Transformer from hey7ys +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hey7ys +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hey7ys` is a English model originally trained by hey7ys. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hey7ys_en_5.4.2_3.0_1724582487331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hey7ys_en_5.4.2_3.0_1724582487331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hey7ys","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hey7ys", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hey7ys| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hey7ys/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline_en.md new file mode 100644 index 00000000000000..a57b9d69c4cc93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline pipeline T5Transformer from hey7ys +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline` is a English model originally trained by hey7ys. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline_en_5.4.2_3.0_1724582574609.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline_en_5.4.2_3.0_1724582574609.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hey7ys_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hey7ys/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_en.md new file mode 100644 index 00000000000000..fffcd4a8a05854 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_keylazy T5Transformer from keylazy +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_keylazy +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_keylazy` is a English model originally trained by keylazy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_keylazy_en_5.4.2_3.0_1724551543326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_keylazy_en_5.4.2_3.0_1724551543326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_keylazy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_keylazy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_keylazy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/keylazy/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline_en.md new file mode 100644 index 00000000000000..c7182664cc995c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline pipeline T5Transformer from keylazy +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline` is a English model originally trained by keylazy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline_en_5.4.2_3.0_1724551678160.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline_en_5.4.2_3.0_1724551678160.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_keylazy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/keylazy/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_en.md new file mode 100644 index 00000000000000..f3a57c39793802 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_macavins T5Transformer from macavins +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_macavins +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_macavins` is a English model originally trained by macavins. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_macavins_en_5.4.2_3.0_1724603506168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_macavins_en_5.4.2_3.0_1724603506168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_macavins","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_macavins", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_macavins| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/macavins/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_pipeline_en.md new file mode 100644 index 00000000000000..cd62d0837b7867 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_macavins_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_macavins_pipeline pipeline T5Transformer from macavins +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_macavins_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_macavins_pipeline` is a English model originally trained by macavins. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_macavins_pipeline_en_5.4.2_3.0_1724603622630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_macavins_pipeline_en_5.4.2_3.0_1724603622630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_macavins_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_macavins_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_macavins_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/macavins/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_en.md new file mode 100644 index 00000000000000..0d2de8cf18277c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_techtank T5Transformer from techtank +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_techtank +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_techtank` is a English model originally trained by techtank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_techtank_en_5.4.2_3.0_1724578539038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_techtank_en_5.4.2_3.0_1724578539038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_techtank","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_techtank", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_techtank| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/techtank/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_pipeline_en.md new file mode 100644 index 00000000000000..776851f26d729b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_amazon_english_spanish_techtank_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_techtank_pipeline pipeline T5Transformer from techtank +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_techtank_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_techtank_pipeline` is a English model originally trained by techtank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_techtank_pipeline_en_5.4.2_3.0_1724578813184.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_techtank_pipeline_en_5.4.2_3.0_1724578813184.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_techtank_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_techtank_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_techtank_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/techtank/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_en.md new file mode 100644 index 00000000000000..05fd9befea205e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_billsum_accelerate T5Transformer from kaiku03 +author: John Snow Labs +name: mt5_small_finetuned_billsum_accelerate +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_billsum_accelerate` is a English model originally trained by kaiku03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_billsum_accelerate_en_5.4.2_3.0_1724545021604.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_billsum_accelerate_en_5.4.2_3.0_1724545021604.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_billsum_accelerate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_billsum_accelerate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_billsum_accelerate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kaiku03/mt5-small-finetuned-billsum-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_pipeline_en.md new file mode 100644 index 00000000000000..c870c70145ade6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_billsum_accelerate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_billsum_accelerate_pipeline pipeline T5Transformer from kaiku03 +author: John Snow Labs +name: mt5_small_finetuned_billsum_accelerate_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_billsum_accelerate_pipeline` is a English model originally trained by kaiku03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_billsum_accelerate_pipeline_en_5.4.2_3.0_1724545159051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_billsum_accelerate_pipeline_en_5.4.2_3.0_1724545159051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_billsum_accelerate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_billsum_accelerate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_billsum_accelerate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kaiku03/mt5-small-finetuned-billsum-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_en.md new file mode 100644 index 00000000000000..41ce3e0aa113b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_gec_0_2 T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_gec_0_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_gec_0_2` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_0_2_en_5.4.2_3.0_1724595588535.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_0_2_en_5.4.2_3.0_1724595588535.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_gec_0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_gec_0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_gec_0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-gec-0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_pipeline_en.md new file mode 100644 index 00000000000000..1de6b67f2c22de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_gec_0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_gec_0_2_pipeline pipeline T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_gec_0_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_gec_0_2_pipeline` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_0_2_pipeline_en_5.4.2_3.0_1724595687221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_0_2_pipeline_en_5.4.2_3.0_1724595687221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_gec_0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_gec_0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_gec_0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-gec-0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_en.md new file mode 100644 index 00000000000000..530fc2f9d2671d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_latin_serbian_summarizer_2 T5Transformer from malbasha98 +author: John Snow Labs +name: mt5_small_finetuned_latin_serbian_summarizer_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_latin_serbian_summarizer_2` is a English model originally trained by malbasha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_latin_serbian_summarizer_2_en_5.4.2_3.0_1724603367096.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_latin_serbian_summarizer_2_en_5.4.2_3.0_1724603367096.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_latin_serbian_summarizer_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_latin_serbian_summarizer_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_latin_serbian_summarizer_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/malbasha98/mt5-small-finetuned-latin-serbian-summarizer-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_pipeline_en.md new file mode 100644 index 00000000000000..6685670a837a24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_latin_serbian_summarizer_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_latin_serbian_summarizer_2_pipeline pipeline T5Transformer from malbasha98 +author: John Snow Labs +name: mt5_small_finetuned_latin_serbian_summarizer_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_latin_serbian_summarizer_2_pipeline` is a English model originally trained by malbasha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_latin_serbian_summarizer_2_pipeline_en_5.4.2_3.0_1724603467258.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_latin_serbian_summarizer_2_pipeline_en_5.4.2_3.0_1724603467258.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_latin_serbian_summarizer_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_latin_serbian_summarizer_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_latin_serbian_summarizer_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/malbasha98/mt5-small-finetuned-latin-serbian-summarizer-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_en.md new file mode 100644 index 00000000000000..aae77d9fbda0e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_mlsum T5Transformer from lewtun +author: John Snow Labs +name: mt5_small_finetuned_mlsum +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mlsum` is a English model originally trained by lewtun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mlsum_en_5.4.2_3.0_1724587302105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mlsum_en_5.4.2_3.0_1724587302105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_mlsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_mlsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mlsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/lewtun/mt5-small-finetuned-mlsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_pipeline_en.md new file mode 100644 index 00000000000000..23d8c300f487d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_mlsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_mlsum_pipeline pipeline T5Transformer from lewtun +author: John Snow Labs +name: mt5_small_finetuned_mlsum_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mlsum_pipeline` is a English model originally trained by lewtun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mlsum_pipeline_en_5.4.2_3.0_1724587589679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mlsum_pipeline_en_5.4.2_3.0_1724587589679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_mlsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_mlsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mlsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/lewtun/mt5-small-finetuned-mlsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_en.md new file mode 100644 index 00000000000000..185cb2d520f574 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230215 T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_multihead_230215 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230215` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230215_en_5.4.2_3.0_1724589357176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230215_en_5.4.2_3.0_1724589357176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230215","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230215", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230215| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-MultiHead-230215 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_pipeline_en.md new file mode 100644 index 00000000000000..154e95d2968a4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230215_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230215_pipeline pipeline T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_multihead_230215_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230215_pipeline` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230215_pipeline_en_5.4.2_3.0_1724589444975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230215_pipeline_en_5.4.2_3.0_1724589444975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_multihead_230215_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_multihead_230215_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230215_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-MultiHead-230215 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_en.md new file mode 100644 index 00000000000000..cdb58b341b7934 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230221_generated_datasets T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_multihead_230221_generated_datasets +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230221_generated_datasets` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230221_generated_datasets_en_5.4.2_3.0_1724582991530.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230221_generated_datasets_en_5.4.2_3.0_1724582991530.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230221_generated_datasets","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230221_generated_datasets", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230221_generated_datasets| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-MultiHead-230221-generated-datasets \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_pipeline_en.md new file mode 100644 index 00000000000000..846b1fcb1928d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_multihead_230221_generated_datasets_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230221_generated_datasets_pipeline pipeline T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_multihead_230221_generated_datasets_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230221_generated_datasets_pipeline` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230221_generated_datasets_pipeline_en_5.4.2_3.0_1724583076686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230221_generated_datasets_pipeline_en_5.4.2_3.0_1724583076686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_multihead_230221_generated_datasets_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_multihead_230221_generated_datasets_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230221_generated_datasets_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-MultiHead-230221-generated-datasets + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_en.md new file mode 100644 index 00000000000000..07ed8f358ba7f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_wikipedia_english T5Transformer from svikt +author: John Snow Labs +name: mt5_small_finetuned_wikipedia_english +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_wikipedia_english` is a English model originally trained by svikt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikipedia_english_en_5.4.2_3.0_1724544800654.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikipedia_english_en_5.4.2_3.0_1724544800654.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_wikipedia_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_wikipedia_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_wikipedia_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/svikt/mt5-small-finetuned-wikipedia-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_pipeline_en.md new file mode 100644 index 00000000000000..6fa725907db731 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_finetuned_wikipedia_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_wikipedia_english_pipeline pipeline T5Transformer from svikt +author: John Snow Labs +name: mt5_small_finetuned_wikipedia_english_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_wikipedia_english_pipeline` is a English model originally trained by svikt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikipedia_english_pipeline_en_5.4.2_3.0_1724544917067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikipedia_english_pipeline_en_5.4.2_3.0_1724544917067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_wikipedia_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_wikipedia_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_wikipedia_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/svikt/mt5-small-finetuned-wikipedia-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_en.md new file mode 100644 index 00000000000000..a6183a8603a3eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_5000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_5000_en_5.4.2_3.0_1724625343034.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_5000_en_5.4.2_3.0_1724625343034.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|195.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_pipeline_en.md new file mode 100644 index 00000000000000..ac6ccae8210a51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_frquad_qa_trimmed_french_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_5000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724625353081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724625353081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|195.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_en.md new file mode 100644 index 00000000000000..aaeaa25e2ae72a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_galician_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_galician_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_galician_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_galician_10k_en_5.4.2_3.0_1724611172632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_galician_10k_en_5.4.2_3.0_1724611172632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_galician_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_galician_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_galician_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-gl-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_pipeline_en.md new file mode 100644 index 00000000000000..aa8d5274164aea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_galician_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_galician_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_galician_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_galician_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_galician_10k_pipeline_en_5.4.2_3.0_1724611343101.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_galician_10k_pipeline_en_5.4.2_3.0_1724611343101.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_galician_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_galician_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_galician_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-gl-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_en.md new file mode 100644 index 00000000000000..ad2e0573d8ec0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_georgian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_georgian_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_georgian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_georgian_10k_en_5.4.2_3.0_1724575842500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_georgian_10k_en_5.4.2_3.0_1724575842500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_georgian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_georgian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_georgian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ka-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_pipeline_en.md new file mode 100644 index 00000000000000..ae222cbd404d84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_georgian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_georgian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_georgian_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_georgian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_georgian_10k_pipeline_en_5.4.2_3.0_1724576003876.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_georgian_10k_pipeline_en_5.4.2_3.0_1724576003876.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_georgian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_georgian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_georgian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ka-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_en.md new file mode 100644 index 00000000000000..5b67659e8d1aff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_greek_modern_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_greek_modern_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_greek_modern_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_greek_modern_10k_en_5.4.2_3.0_1724579445743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_greek_modern_10k_en_5.4.2_3.0_1724579445743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_greek_modern_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_greek_modern_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_greek_modern_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-el-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_pipeline_en.md new file mode 100644 index 00000000000000..63fa77175a37d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_greek_modern_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_greek_modern_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_greek_modern_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_greek_modern_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_greek_modern_10k_pipeline_en_5.4.2_3.0_1724579601177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_greek_modern_10k_pipeline_en_5.4.2_3.0_1724579601177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_greek_modern_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_greek_modern_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_greek_modern_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-el-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_en.md new file mode 100644 index 00000000000000..7ee8f925790c63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_hindi_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_hindi_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_hindi_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_hindi_10k_en_5.4.2_3.0_1724553171948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_hindi_10k_en_5.4.2_3.0_1724553171948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_hindi_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_hindi_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_hindi_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-hi-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_pipeline_en.md new file mode 100644 index 00000000000000..4aa341df36243a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_hindi_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_hindi_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_hindi_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_hindi_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_hindi_10k_pipeline_en_5.4.2_3.0_1724553334948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_hindi_10k_pipeline_en_5.4.2_3.0_1724553334948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_hindi_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_hindi_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_hindi_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-hi-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_en.md new file mode 100644 index 00000000000000..795d66b01f513a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_italian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_italian_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_italian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_italian_10k_en_5.4.2_3.0_1724553935105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_italian_10k_en_5.4.2_3.0_1724553935105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_italian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_italian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_italian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-it-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_pipeline_en.md new file mode 100644 index 00000000000000..37080a1f9df61b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_italian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_italian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_italian_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_italian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_italian_10k_pipeline_en_5.4.2_3.0_1724554090076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_italian_10k_pipeline_en_5.4.2_3.0_1724554090076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_italian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_italian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_italian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-it-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_en.md new file mode 100644 index 00000000000000..f6eb160906cc40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_jaquad_qa_trimmed_japanese_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qa_trimmed_japanese_90000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa_trimmed_japanese_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_90000_en_5.4.2_3.0_1724547725405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_90000_en_5.4.2_3.0_1724547725405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qa_trimmed_japanese_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qa_trimmed_japanese_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa_trimmed_japanese_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|583.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qa-trimmed-ja-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline_en.md new file mode 100644 index 00000000000000..2de26974fcdece --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline_en_5.4.2_3.0_1724547760111.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline_en_5.4.2_3.0_1724547760111.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa_trimmed_japanese_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|583.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qa-trimmed-ja-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_en.md new file mode 100644 index 00000000000000..d032a479edefdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_koquad_qa_trimmed_korean_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qa_trimmed_korean_30000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qa_trimmed_korean_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_30000_en_5.4.2_3.0_1724556899696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_30000_en_5.4.2_3.0_1724556899696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_koquad_qa_trimmed_korean_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_koquad_qa_trimmed_korean_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qa_trimmed_korean_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|315.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qa-trimmed-ko-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_pipeline_en.md new file mode 100644 index 00000000000000..6805c9b1830baf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_koquad_qa_trimmed_korean_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_koquad_qa_trimmed_korean_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qa_trimmed_korean_30000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qa_trimmed_korean_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_30000_pipeline_en_5.4.2_3.0_1724556917444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_30000_pipeline_en_5.4.2_3.0_1724556917444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_koquad_qa_trimmed_korean_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_koquad_qa_trimmed_korean_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qa_trimmed_korean_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|315.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qa-trimmed-ko-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_en.md new file mode 100644 index 00000000000000..eee67371f14ad9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_mlsum_domain_specific_paraphraser_v2 T5Transformer from guidoivetta +author: John Snow Labs +name: mt5_small_mlsum_domain_specific_paraphraser_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mlsum_domain_specific_paraphraser_v2` is a English model originally trained by guidoivetta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v2_en_5.4.2_3.0_1724559856332.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v2_en_5.4.2_3.0_1724559856332.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_mlsum_domain_specific_paraphraser_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_mlsum_domain_specific_paraphraser_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mlsum_domain_specific_paraphraser_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/guidoivetta/mt5-small-mlsum_domain-specific-paraphraser_V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline_en.md new file mode 100644 index 00000000000000..0cb8bdf08853a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline pipeline T5Transformer from guidoivetta +author: John Snow Labs +name: mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline` is a English model originally trained by guidoivetta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline_en_5.4.2_3.0_1724559996632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline_en_5.4.2_3.0_1724559996632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mlsum_domain_specific_paraphraser_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/guidoivetta/mt5-small-mlsum_domain-specific-paraphraser_V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_en.md new file mode 100644 index 00000000000000..a0cce61fde6416 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_model T5Transformer from rabby33 +author: John Snow Labs +name: mt5_small_model +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_model` is a English model originally trained by rabby33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_model_en_5.4.2_3.0_1724572317162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_model_en_5.4.2_3.0_1724572317162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/rabby33/mt5-small-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_pipeline_en.md new file mode 100644 index 00000000000000..bef6d41b0affd3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_model_pipeline pipeline T5Transformer from rabby33 +author: John Snow Labs +name: mt5_small_model_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_model_pipeline` is a English model originally trained by rabby33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_model_pipeline_en_5.4.2_3.0_1724572593136.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_model_pipeline_en_5.4.2_3.0_1724572593136.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/rabby33/mt5-small-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_en.md new file mode 100644 index 00000000000000..027d6d205016f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_mongolian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_mongolian_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mongolian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mongolian_10k_en_5.4.2_3.0_1724589341146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mongolian_10k_en_5.4.2_3.0_1724589341146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_mongolian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_mongolian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mongolian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-mn-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_pipeline_en.md new file mode 100644 index 00000000000000..d8a1a632da5fda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_mongolian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_mongolian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_mongolian_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mongolian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mongolian_10k_pipeline_en_5.4.2_3.0_1724589498450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mongolian_10k_pipeline_en_5.4.2_3.0_1724589498450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_mongolian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_mongolian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mongolian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-mn-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_en.md new file mode 100644 index 00000000000000..88f5212724a440 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_50k_deen T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_50k_deen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_50k_deen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_deen_en_5.4.2_3.0_1724547391537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_deen_en_5.4.2_3.0_1724547391537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_50k_deen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_50k_deen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_50k_deen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-50k-deen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_pipeline_en.md new file mode 100644 index 00000000000000..98a9d5393fe1f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_nc16_50k_deen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_50k_deen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_50k_deen_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_50k_deen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_deen_pipeline_en_5.4.2_3.0_1724547560704.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_deen_pipeline_en_5.4.2_3.0_1724547560704.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_50k_deen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_50k_deen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_50k_deen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-50k-deen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_en.md new file mode 100644 index 00000000000000..c183fcd766ed09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_old T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_old +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_old` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_old_en_5.4.2_3.0_1724575050050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_old_en_5.4.2_3.0_1724575050050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_old","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_old", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_old| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_old \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_pipeline_en.md new file mode 100644 index 00000000000000..2097cb6a1e2087 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_old_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_old_pipeline pipeline T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_old_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_old_pipeline` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_old_pipeline_en_5.4.2_3.0_1724575138877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_old_pipeline_en_5.4.2_3.0_1724575138877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_old_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_old_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_old_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_old + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_en.md new file mode 100644 index 00000000000000..bf64b8f8d4d256 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_search_summarizer T5Transformer from surprisedPikachu007 +author: John Snow Labs +name: mt5_small_search_summarizer +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_search_summarizer` is a English model originally trained by surprisedPikachu007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_search_summarizer_en_5.4.2_3.0_1724597341472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_search_summarizer_en_5.4.2_3.0_1724597341472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_search_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_search_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_search_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/surprisedPikachu007/mt5-small-search-summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..663630e0fa32de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_search_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_search_summarizer_pipeline pipeline T5Transformer from surprisedPikachu007 +author: John Snow Labs +name: mt5_small_search_summarizer_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_search_summarizer_pipeline` is a English model originally trained by surprisedPikachu007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_search_summarizer_pipeline_en_5.4.2_3.0_1724597458170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_search_summarizer_pipeline_en_5.4.2_3.0_1724597458170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_search_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_search_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_search_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/surprisedPikachu007/mt5-small-search-summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_en.md new file mode 100644 index 00000000000000..35d088cecaaed7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_summarization_mlsum_spanish T5Transformer from edumunozsala +author: John Snow Labs +name: mt5_small_summarization_mlsum_spanish +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_mlsum_spanish` is a English model originally trained by edumunozsala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_mlsum_spanish_en_5.4.2_3.0_1724607326602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_mlsum_spanish_en_5.4.2_3.0_1724607326602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_summarization_mlsum_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_summarization_mlsum_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_mlsum_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/edumunozsala/mt5-small-summarization-mlsum-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_pipeline_en.md new file mode 100644 index 00000000000000..41dddd79edf755 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_summarization_mlsum_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_summarization_mlsum_spanish_pipeline pipeline T5Transformer from edumunozsala +author: John Snow Labs +name: mt5_small_summarization_mlsum_spanish_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_mlsum_spanish_pipeline` is a English model originally trained by edumunozsala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_mlsum_spanish_pipeline_en_5.4.2_3.0_1724607407042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_mlsum_spanish_pipeline_en_5.4.2_3.0_1724607407042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_summarization_mlsum_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_summarization_mlsum_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_mlsum_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/edumunozsala/mt5-small-summarization-mlsum-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_en.md new file mode 100644 index 00000000000000..62b2cafe5978b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_translation_en2vi T5Transformer from harouzie +author: John Snow Labs +name: mt5_small_translation_en2vi +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_translation_en2vi` is a English model originally trained by harouzie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_translation_en2vi_en_5.4.2_3.0_1724625729190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_translation_en2vi_en_5.4.2_3.0_1724625729190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_translation_en2vi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_translation_en2vi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_translation_en2vi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/harouzie/mt5-small-translation-en2vi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_pipeline_en.md new file mode 100644 index 00000000000000..ae9084c9169905 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_translation_en2vi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_translation_en2vi_pipeline pipeline T5Transformer from harouzie +author: John Snow Labs +name: mt5_small_translation_en2vi_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_translation_en2vi_pipeline` is a English model originally trained by harouzie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_translation_en2vi_pipeline_en_5.4.2_3.0_1724625905381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_translation_en2vi_pipeline_en_5.4.2_3.0_1724625905381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_translation_en2vi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_translation_en2vi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_translation_en2vi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/harouzie/mt5-small-translation-en2vi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_en.md new file mode 100644 index 00000000000000..5a360505f15683 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_en_5.4.2_3.0_1724575446957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_en_5.4.2_3.0_1724575446957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_pipeline_en.md new file mode 100644 index 00000000000000..353d485c84dc2a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_pipeline_en_5.4.2_3.0_1724575487464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_pipeline_en_5.4.2_3.0_1724575487464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_en.md new file mode 100644 index 00000000000000..ff0620d49caec4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000_squad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000_squad_qg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000_squad_qg` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qg_en_5.4.2_3.0_1724616610759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qg_en_5.4.2_3.0_1724616610759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000_squad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000_squad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000_squad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_pipeline_en.md new file mode 100644 index 00000000000000..725a7e3218d191 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_english_30000_squad_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000_squad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000_squad_qg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000_squad_qg_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qg_pipeline_en_5.4.2_3.0_1724616629672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qg_pipeline_en_5.4.2_3.0_1724616629672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_30000_squad_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_30000_squad_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000_squad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000-squad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_en.md new file mode 100644 index 00000000000000..bb97bfb0af90c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_french_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_en_5.4.2_3.0_1724621827831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_en_5.4.2_3.0_1724621827831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_pipeline_en.md new file mode 100644 index 00000000000000..138fc9686899c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_french_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724621862859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724621862859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_fr.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_fr.md new file mode 100644 index 00000000000000..209c3f490f04e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_60000_frquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_60000_frquad_qg +date: 2024-08-25 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_60000_frquad_qg` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qg_fr_5.4.2_3.0_1724590474738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qg_fr_5.4.2_3.0_1724590474738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_60000_frquad_qg","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_60000_frquad_qg", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_60000_frquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|458.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-60000-frquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_pipeline_fr.md new file mode 100644 index 00000000000000..a927c37728bf8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_french_60000_frquad_qg_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_60000_frquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_60000_frquad_qg_pipeline +date: 2024-08-25 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_60000_frquad_qg_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qg_pipeline_fr_5.4.2_3.0_1724590500368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qg_pipeline_fr_5.4.2_3.0_1724590500368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_60000_frquad_qg_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_60000_frquad_qg_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_60000_frquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|458.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-60000-frquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_it.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_it.md new file mode 100644 index 00000000000000..5d2ea3d4367888 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_60000_itquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_60000_itquad_qg +date: 2024-08-25 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_60000_itquad_qg` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_60000_itquad_qg_it_5.4.2_3.0_1724617326819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_60000_itquad_qg_it_5.4.2_3.0_1724617326819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_60000_itquad_qg","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_60000_itquad_qg", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_60000_itquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|478.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-60000-itquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_pipeline_it.md new file mode 100644 index 00000000000000..17362428363c9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_italian_60000_itquad_qg_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_60000_itquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_60000_itquad_qg_pipeline +date: 2024-08-25 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_60000_itquad_qg_pipeline` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_60000_itquad_qg_pipeline_it_5.4.2_3.0_1724617353578.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_60000_itquad_qg_pipeline_it_5.4.2_3.0_1724617353578.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_60000_itquad_qg_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_60000_itquad_qg_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_60000_itquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|478.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-60000-itquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..abe09c3fb27c36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_120000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000_jaquad_qg +date: 2024-08-25 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qg_ja_5.4.2_3.0_1724602056601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qg_ja_5.4.2_3.0_1724602056601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|704.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..ccf49729485e8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline +date: 2024-08-25 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724602103788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724602103788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|704.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..a79ca2e5f3a2df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_30000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000_jaquad_qg +date: 2024-08-25 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qg_ja_5.4.2_3.0_1724626633725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qg_ja_5.4.2_3.0_1724626633725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|326.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..8cac7d7c6c7c5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline +date: 2024-08-25 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724626649810.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724626649810.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|326.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_pipeline_ru.md new file mode 100644 index 00000000000000..eebe02b921972d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_10000_ruquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_10000_ruquad_qg_pipeline +date: 2024-08-25 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_10000_ruquad_qg_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724589576602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724589576602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_10000_ruquad_qg_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_10000_ruquad_qg_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_10000_ruquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-10000-ruquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_ru.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_ru.md new file mode 100644 index 00000000000000..1a114d1a6d35d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_russian_10000_ruquad_qg_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_10000_ruquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_10000_ruquad_qg +date: 2024-08-25 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_10000_ruquad_qg` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qg_ru_5.4.2_3.0_1724589565119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_10000_ruquad_qg_ru_5.4.2_3.0_1724589565119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_10000_ruquad_qg","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_10000_ruquad_qg", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_10000_ruquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-10000-ruquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_es.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_es.md new file mode 100644 index 00000000000000..e28587f401273b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_90000_esquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_90000_esquad_qg +date: 2024-08-25 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_90000_esquad_qg` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_esquad_qg_es_5.4.2_3.0_1724569749217.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_esquad_qg_es_5.4.2_3.0_1724569749217.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_90000_esquad_qg","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_90000_esquad_qg", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_90000_esquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|595.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-90000-esquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_pipeline_es.md new file mode 100644 index 00000000000000..e7f2f405a3355c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_trimmed_spanish_90000_esquad_qg_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_90000_esquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_90000_esquad_qg_pipeline +date: 2024-08-25 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_90000_esquad_qg_pipeline` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_esquad_qg_pipeline_es_5.4.2_3.0_1724569787014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_esquad_qg_pipeline_es_5.4.2_3.0_1724569787014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_90000_esquad_qg_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_90000_esquad_qg_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_90000_esquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|595.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-90000-esquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_en.md new file mode 100644 index 00000000000000..32d603f7567446 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_western_frisian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_western_frisian_10k +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_western_frisian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_western_frisian_10k_en_5.4.2_3.0_1724591943332.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_western_frisian_10k_en_5.4.2_3.0_1724591943332.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_western_frisian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_western_frisian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_western_frisian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-fy-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_pipeline_en.md new file mode 100644 index 00000000000000..06ac1c5cfe9fab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_western_frisian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_western_frisian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_western_frisian_10k_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_western_frisian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_western_frisian_10k_pipeline_en_5.4.2_3.0_1724592109723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_western_frisian_10k_pipeline_en_5.4.2_3.0_1724592109723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_western_frisian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_western_frisian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_western_frisian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-fy-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..696ff4e80fbbd7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_zhquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_zhquad_ae_trimmed_50000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_zhquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_ae_trimmed_50000_en_5.4.2_3.0_1724587550569.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_ae_trimmed_50000_en_5.4.2_3.0_1724587550569.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_zhquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_zhquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_zhquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|414.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-zhquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..102b5ceb038e46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_small_zhquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_zhquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_zhquad_ae_trimmed_50000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_zhquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724587573126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724587573126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_zhquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_zhquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_zhquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|414.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-zhquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_en.md new file mode 100644 index 00000000000000..d1bccd963aa2da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_sum T5Transformer from nguyendangsonlam +author: John Snow Labs +name: mt5_sum +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_sum` is a English model originally trained by nguyendangsonlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_sum_en_5.4.2_3.0_1724584807216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_sum_en_5.4.2_3.0_1724584807216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/nguyendangsonlam/mt5-sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_pipeline_en.md new file mode 100644 index 00000000000000..45c44aa8b51a25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-mt5_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_sum_pipeline pipeline T5Transformer from nguyendangsonlam +author: John Snow Labs +name: mt5_sum_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_sum_pipeline` is a English model originally trained by nguyendangsonlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_sum_pipeline_en_5.4.2_3.0_1724584943607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_sum_pipeline_en_5.4.2_3.0_1724584943607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/nguyendangsonlam/mt5-sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_en.md b/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_en.md new file mode 100644 index 00000000000000..130bffc7493084 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English multi3woz_english_dst_mt5_small T5Transformer from songbo +author: John Snow Labs +name: multi3woz_english_dst_mt5_small +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi3woz_english_dst_mt5_small` is a English model originally trained by songbo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi3woz_english_dst_mt5_small_en_5.4.2_3.0_1724622795120.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi3woz_english_dst_mt5_small_en_5.4.2_3.0_1724622795120.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("multi3woz_english_dst_mt5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("multi3woz_english_dst_mt5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi3woz_english_dst_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/songbo/multi3woz-en-dst-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_pipeline_en.md new file mode 100644 index 00000000000000..81b37fcec008fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-multi3woz_english_dst_mt5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English multi3woz_english_dst_mt5_small_pipeline pipeline T5Transformer from songbo +author: John Snow Labs +name: multi3woz_english_dst_mt5_small_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi3woz_english_dst_mt5_small_pipeline` is a English model originally trained by songbo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi3woz_english_dst_mt5_small_pipeline_en_5.4.2_3.0_1724622890516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi3woz_english_dst_mt5_small_pipeline_en_5.4.2_3.0_1724622890516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("multi3woz_english_dst_mt5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("multi3woz_english_dst_mt5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi3woz_english_dst_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/songbo/multi3woz-en-dst-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-nato_chat_en.md b/docs/_posts/ahmedlone127/2024-08-25-nato_chat_en.md new file mode 100644 index 00000000000000..b2edfac230b3dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-nato_chat_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nato_chat T5Transformer from hashimrazi9 +author: John Snow Labs +name: nato_chat +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nato_chat` is a English model originally trained by hashimrazi9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nato_chat_en_5.4.2_3.0_1724580974415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nato_chat_en_5.4.2_3.0_1724580974415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nato_chat","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nato_chat", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nato_chat| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hashimrazi9/nato-chat \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-nato_chat_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-nato_chat_pipeline_en.md new file mode 100644 index 00000000000000..db7df5fae784cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-nato_chat_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nato_chat_pipeline pipeline T5Transformer from hashimrazi9 +author: John Snow Labs +name: nato_chat_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nato_chat_pipeline` is a English model originally trained by hashimrazi9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nato_chat_pipeline_en_5.4.2_3.0_1724581019092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nato_chat_pipeline_en_5.4.2_3.0_1724581019092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nato_chat_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nato_chat_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nato_chat_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hashimrazi9/nato-chat + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_en.md new file mode 100644 index 00000000000000..39d44555ad9ec1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English norwegian_sum_t5_3 T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_3` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_3_en_5.4.2_3.0_1724573152980.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_3_en_5.4.2_3.0_1724573152980.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("norwegian_sum_t5_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("norwegian_sum_t5_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.0 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_pipeline_en.md new file mode 100644 index 00000000000000..9dd63e465fc59d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-norwegian_sum_t5_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English norwegian_sum_t5_3_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_3_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_3_pipeline_en_5.4.2_3.0_1724573173949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_3_pipeline_en_5.4.2_3.0_1724573173949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("norwegian_sum_t5_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("norwegian_sum_t5_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.0 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_en.md b/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_en.md new file mode 100644 index 00000000000000..29657f0d3f3f2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nt5_small_iirc_retrieved T5Transformer from StonyBrookNLP +author: John Snow Labs +name: nt5_small_iirc_retrieved +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nt5_small_iirc_retrieved` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nt5_small_iirc_retrieved_en_5.4.2_3.0_1724574394486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nt5_small_iirc_retrieved_en_5.4.2_3.0_1724574394486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nt5_small_iirc_retrieved","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nt5_small_iirc_retrieved", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nt5_small_iirc_retrieved| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.3 MB| + +## References + +https://huggingface.co/StonyBrookNLP/nt5-small-iirc-retrieved \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_pipeline_en.md new file mode 100644 index 00000000000000..96eca772befe6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-nt5_small_iirc_retrieved_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nt5_small_iirc_retrieved_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: nt5_small_iirc_retrieved_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nt5_small_iirc_retrieved_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nt5_small_iirc_retrieved_pipeline_en_5.4.2_3.0_1724574412158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nt5_small_iirc_retrieved_pipeline_en_5.4.2_3.0_1724574412158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nt5_small_iirc_retrieved_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nt5_small_iirc_retrieved_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nt5_small_iirc_retrieved_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.3 MB| + +## References + +https://huggingface.co/StonyBrookNLP/nt5-small-iirc-retrieved + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-one_variable_en.md b/docs/_posts/ahmedlone127/2024-08-25-one_variable_en.md new file mode 100644 index 00000000000000..c26bd636f2e36c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-one_variable_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English one_variable T5Transformer from NisthaBajra +author: John Snow Labs +name: one_variable +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`one_variable` is a English model originally trained by NisthaBajra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/one_variable_en_5.4.2_3.0_1724560886157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/one_variable_en_5.4.2_3.0_1724560886157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("one_variable","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("one_variable", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|one_variable| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NisthaBajra/one_variable \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-one_variable_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-one_variable_pipeline_en.md new file mode 100644 index 00000000000000..c425186acee6d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-one_variable_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English one_variable_pipeline pipeline T5Transformer from NisthaBajra +author: John Snow Labs +name: one_variable_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`one_variable_pipeline` is a English model originally trained by NisthaBajra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/one_variable_pipeline_en_5.4.2_3.0_1724560944727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/one_variable_pipeline_en_5.4.2_3.0_1724560944727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("one_variable_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("one_variable_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|one_variable_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NisthaBajra/one_variable + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_en.md b/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_en.md new file mode 100644 index 00000000000000..9f85b6250c04f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pretrain_law_model_vit5_version1 T5Transformer from KingLTD +author: John Snow Labs +name: pretrain_law_model_vit5_version1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrain_law_model_vit5_version1` is a English model originally trained by KingLTD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrain_law_model_vit5_version1_en_5.4.2_3.0_1724582345853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrain_law_model_vit5_version1_en_5.4.2_3.0_1724582345853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pretrain_law_model_vit5_version1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pretrain_law_model_vit5_version1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrain_law_model_vit5_version1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KingLTD/pretrain_Law_model_vit5_version1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_pipeline_en.md new file mode 100644 index 00000000000000..d6faaadc2ad748 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-pretrain_law_model_vit5_version1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pretrain_law_model_vit5_version1_pipeline pipeline T5Transformer from KingLTD +author: John Snow Labs +name: pretrain_law_model_vit5_version1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrain_law_model_vit5_version1_pipeline` is a English model originally trained by KingLTD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrain_law_model_vit5_version1_pipeline_en_5.4.2_3.0_1724582397179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrain_law_model_vit5_version1_pipeline_en_5.4.2_3.0_1724582397179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pretrain_law_model_vit5_version1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pretrain_law_model_vit5_version1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrain_law_model_vit5_version1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KingLTD/pretrain_Law_model_vit5_version1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_en.md b/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_en.md new file mode 100644 index 00000000000000..d17a2837382d0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pretrained_recl8 T5Transformer from mika5883 +author: John Snow Labs +name: pretrained_recl8 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrained_recl8` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrained_recl8_en_5.4.2_3.0_1724608136923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrained_recl8_en_5.4.2_3.0_1724608136923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pretrained_recl8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pretrained_recl8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrained_recl8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Pretrained_ReCl8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_pipeline_en.md new file mode 100644 index 00000000000000..8b49aa76db6f38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-pretrained_recl8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pretrained_recl8_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: pretrained_recl8_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrained_recl8_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrained_recl8_pipeline_en_5.4.2_3.0_1724608187605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrained_recl8_pipeline_en_5.4.2_3.0_1724608187605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pretrained_recl8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pretrained_recl8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrained_recl8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Pretrained_ReCl8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_en.md new file mode 100644 index 00000000000000..65275be7c04b3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qa_indo_math_k_v2 T5Transformer from fadhilarkan +author: John Snow Labs +name: qa_indo_math_k_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_indo_math_k_v2` is a English model originally trained by fadhilarkan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_v2_en_5.4.2_3.0_1724588987215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_v2_en_5.4.2_3.0_1724588987215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qa_indo_math_k_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qa_indo_math_k_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_indo_math_k_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.4 MB| + +## References + +https://huggingface.co/fadhilarkan/qa-indo-math-k-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_pipeline_en.md new file mode 100644 index 00000000000000..4089c31a12e906 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qa_indo_math_k_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qa_indo_math_k_v2_pipeline pipeline T5Transformer from fadhilarkan +author: John Snow Labs +name: qa_indo_math_k_v2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_indo_math_k_v2_pipeline` is a English model originally trained by fadhilarkan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_v2_pipeline_en_5.4.2_3.0_1724589004535.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_v2_pipeline_en_5.4.2_3.0_1724589004535.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qa_indo_math_k_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qa_indo_math_k_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_indo_math_k_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.4 MB| + +## References + +https://huggingface.co/fadhilarkan/qa-indo-math-k-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_en.md new file mode 100644 index 00000000000000..6ae01c0c0c7b4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qcpg_parabk2_mt5 T5Transformer from bibekyess +author: John Snow Labs +name: qcpg_parabk2_mt5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_parabk2_mt5` is a English model originally trained by bibekyess. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_parabk2_mt5_en_5.4.2_3.0_1724588223301.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_parabk2_mt5_en_5.4.2_3.0_1724588223301.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qcpg_parabk2_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qcpg_parabk2_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_parabk2_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/bibekyess/qcpg-parabk2-mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_pipeline_en.md new file mode 100644 index 00000000000000..539144b886f251 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qcpg_parabk2_mt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qcpg_parabk2_mt5_pipeline pipeline T5Transformer from bibekyess +author: John Snow Labs +name: qcpg_parabk2_mt5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_parabk2_mt5_pipeline` is a English model originally trained by bibekyess. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_parabk2_mt5_pipeline_en_5.4.2_3.0_1724588402911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_parabk2_mt5_pipeline_en_5.4.2_3.0_1724588402911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qcpg_parabk2_mt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qcpg_parabk2_mt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_parabk2_mt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/bibekyess/qcpg-parabk2-mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_en.md new file mode 100644 index 00000000000000..857ad03566e131 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qgen_model_acm_2 T5Transformer from abhir00p +author: John Snow Labs +name: qgen_model_acm_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qgen_model_acm_2` is a English model originally trained by abhir00p. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qgen_model_acm_2_en_5.4.2_3.0_1724602166450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qgen_model_acm_2_en_5.4.2_3.0_1724602166450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qgen_model_acm_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qgen_model_acm_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qgen_model_acm_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/abhir00p/Qgen_model_ACM_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_pipeline_en.md new file mode 100644 index 00000000000000..eed35006687af3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qgen_model_acm_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qgen_model_acm_2_pipeline pipeline T5Transformer from abhir00p +author: John Snow Labs +name: qgen_model_acm_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qgen_model_acm_2_pipeline` is a English model originally trained by abhir00p. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qgen_model_acm_2_pipeline_en_5.4.2_3.0_1724602218857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qgen_model_acm_2_pipeline_en_5.4.2_3.0_1724602218857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qgen_model_acm_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qgen_model_acm_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qgen_model_acm_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/abhir00p/Qgen_model_ACM_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_en.md new file mode 100644 index 00000000000000..5e6acc19ac28d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qqp_t5_base_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_base_seed_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_base_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_base_seed_2_en_5.4.2_3.0_1724555596696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_base_seed_2_en_5.4.2_3.0_1724555596696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qqp_t5_base_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qqp_t5_base_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_base_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.4 MB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-base_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..558bd132c282c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-qqp_t5_base_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qqp_t5_base_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_base_seed_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_base_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_base_seed_2_pipeline_en_5.4.2_3.0_1724555651695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_base_seed_2_pipeline_en_5.4.2_3.0_1724555651695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qqp_t5_base_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qqp_t5_base_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_base_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.4 MB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-base_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_en.md b/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_en.md new file mode 100644 index 00000000000000..5ebea8e98c93eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English quotevibes_model_trained T5Transformer from Rozi05 +author: John Snow Labs +name: quotevibes_model_trained +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quotevibes_model_trained` is a English model originally trained by Rozi05. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quotevibes_model_trained_en_5.4.2_3.0_1724583539571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quotevibes_model_trained_en_5.4.2_3.0_1724583539571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("quotevibes_model_trained","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("quotevibes_model_trained", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quotevibes_model_trained| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Rozi05/QuoteVibes_Model_Trained \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_pipeline_en.md new file mode 100644 index 00000000000000..bc8e6f2af3c8ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-quotevibes_model_trained_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English quotevibes_model_trained_pipeline pipeline T5Transformer from Rozi05 +author: John Snow Labs +name: quotevibes_model_trained_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quotevibes_model_trained_pipeline` is a English model originally trained by Rozi05. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quotevibes_model_trained_pipeline_en_5.4.2_3.0_1724583668593.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quotevibes_model_trained_pipeline_en_5.4.2_3.0_1724583668593.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("quotevibes_model_trained_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("quotevibes_model_trained_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quotevibes_model_trained_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Rozi05/QuoteVibes_Model_Trained + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-real_prompt_100_500sync_all_gen_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_100_500sync_all_gen_t5_large_en.md new file mode 100644 index 00000000000000..258a86a9bb92c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_100_500sync_all_gen_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_100_500sync_all_gen_t5_large T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_100_500sync_all_gen_t5_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_100_500sync_all_gen_t5_large` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_100_500sync_all_gen_t5_large_en_5.4.2_3.0_1724582907285.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_100_500sync_all_gen_t5_large_en_5.4.2_3.0_1724582907285.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_100_500sync_all_gen_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_100_500sync_all_gen_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_100_500sync_all_gen_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-100-500sync-all-gen-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_en.md new file mode 100644 index 00000000000000..b4f33ba3e98179 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_300_root_cause_gen_t5_base T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_root_cause_gen_t5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_root_cause_gen_t5_base` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_root_cause_gen_t5_base_en_5.4.2_3.0_1724621622461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_root_cause_gen_t5_base_en_5.4.2_3.0_1724621622461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_300_root_cause_gen_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_300_root_cause_gen_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_root_cause_gen_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-root_cause-gen-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..f4a99c085f50d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-real_prompt_300_root_cause_gen_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English real_prompt_300_root_cause_gen_t5_base_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_root_cause_gen_t5_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_root_cause_gen_t5_base_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_root_cause_gen_t5_base_pipeline_en_5.4.2_3.0_1724621801088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_root_cause_gen_t5_base_pipeline_en_5.4.2_3.0_1724621801088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("real_prompt_300_root_cause_gen_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("real_prompt_300_root_cause_gen_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_root_cause_gen_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-root_cause-gen-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-results_akshra_en.md b/docs/_posts/ahmedlone127/2024-08-25-results_akshra_en.md new file mode 100644 index 00000000000000..239977f4c704f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-results_akshra_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_akshra T5Transformer from akshra +author: John Snow Labs +name: results_akshra +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_akshra` is a English model originally trained by akshra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_akshra_en_5.4.2_3.0_1724584002463.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_akshra_en_5.4.2_3.0_1724584002463.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_akshra","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_akshra", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_akshra| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.2 MB| + +## References + +https://huggingface.co/akshra/results \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-results_akshra_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-results_akshra_pipeline_en.md new file mode 100644 index 00000000000000..7e107890446901 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-results_akshra_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_akshra_pipeline pipeline T5Transformer from akshra +author: John Snow Labs +name: results_akshra_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_akshra_pipeline` is a English model originally trained by akshra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_akshra_pipeline_en_5.4.2_3.0_1724584019758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_akshra_pipeline_en_5.4.2_3.0_1724584019758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_akshra_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_akshra_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_akshra_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.2 MB| + +## References + +https://huggingface.co/akshra/results + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-robustgen_en.md b/docs/_posts/ahmedlone127/2024-08-25-robustgen_en.md new file mode 100644 index 00000000000000..d7e1b8d22dfd83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-robustgen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English robustgen T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: robustgen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`robustgen` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/robustgen_en_5.4.2_3.0_1724560501772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/robustgen_en_5.4.2_3.0_1724560501772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("robustgen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("robustgen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|robustgen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/RobustGen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-robustgen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-robustgen_pipeline_en.md new file mode 100644 index 00000000000000..37181d9b3708c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-robustgen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English robustgen_pipeline pipeline T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: robustgen_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`robustgen_pipeline` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/robustgen_pipeline_en_5.4.2_3.0_1724560550455.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/robustgen_pipeline_en_5.4.2_3.0_1724560550455.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("robustgen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("robustgen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|robustgen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/RobustGen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_en.md new file mode 100644 index 00000000000000..a92a8ac1defcce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rotten_tomatoes_t5_base_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: rotten_tomatoes_t5_base_seed_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rotten_tomatoes_t5_base_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_base_seed_1_en_5.4.2_3.0_1724613693084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_base_seed_1_en_5.4.2_3.0_1724613693084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rotten_tomatoes_t5_base_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rotten_tomatoes_t5_base_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rotten_tomatoes_t5_base_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|939.5 MB| + +## References + +https://huggingface.co/utahnlp/rotten_tomatoes_t5-base_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..d44e8824027341 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_base_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rotten_tomatoes_t5_base_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: rotten_tomatoes_t5_base_seed_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rotten_tomatoes_t5_base_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724613761248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724613761248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rotten_tomatoes_t5_base_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rotten_tomatoes_t5_base_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rotten_tomatoes_t5_base_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|939.5 MB| + +## References + +https://huggingface.co/utahnlp/rotten_tomatoes_t5-base_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_en.md new file mode 100644 index 00000000000000..1d457e3baf5e91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rotten_tomatoes_t5_large_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: rotten_tomatoes_t5_large_seed_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rotten_tomatoes_t5_large_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_large_seed_3_en_5.4.2_3.0_1724576200008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_large_seed_3_en_5.4.2_3.0_1724576200008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rotten_tomatoes_t5_large_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rotten_tomatoes_t5_large_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rotten_tomatoes_t5_large_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/rotten_tomatoes_t5-large_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..f091340f8d87eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rotten_tomatoes_t5_large_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rotten_tomatoes_t5_large_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: rotten_tomatoes_t5_large_seed_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rotten_tomatoes_t5_large_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724576373064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rotten_tomatoes_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724576373064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rotten_tomatoes_t5_large_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rotten_tomatoes_t5_large_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rotten_tomatoes_t5_large_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/rotten_tomatoes_t5-large_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_en.md b/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_en.md new file mode 100644 index 00000000000000..5781100d50cc95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned_lith T5Transformer from Natet +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned_lith +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned_lith` is a English model originally trained by Natet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_lith_en_5.4.2_3.0_1724575098867.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_lith_en_5.4.2_3.0_1724575098867.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned_lith","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned_lith", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned_lith| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/Natet/rut5_base_sum_gazeta-finetuned_lith \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_pipeline_en.md new file mode 100644 index 00000000000000..b9af3d1034ad74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-rut5_base_sum_gazeta_finetuned_lith_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned_lith_pipeline pipeline T5Transformer from Natet +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned_lith_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned_lith_pipeline` is a English model originally trained by Natet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_lith_pipeline_en_5.4.2_3.0_1724575146874.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_lith_pipeline_en_5.4.2_3.0_1724575146874.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_sum_gazeta_finetuned_lith_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_sum_gazeta_finetuned_lith_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned_lith_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/Natet/rut5_base_sum_gazeta-finetuned_lith + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_en.md new file mode 100644 index 00000000000000..e4cc3c2a8631c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English samsum_4208_t5_base T5Transformer from ryusangwon +author: John Snow Labs +name: samsum_4208_t5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`samsum_4208_t5_base` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/samsum_4208_t5_base_en_5.4.2_3.0_1724546067075.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/samsum_4208_t5_base_en_5.4.2_3.0_1724546067075.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("samsum_4208_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("samsum_4208_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|samsum_4208_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.3 MB| + +## References + +https://huggingface.co/ryusangwon/samsum_4208_t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..bd377f9a041612 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-samsum_4208_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English samsum_4208_t5_base_pipeline pipeline T5Transformer from ryusangwon +author: John Snow Labs +name: samsum_4208_t5_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`samsum_4208_t5_base_pipeline` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/samsum_4208_t5_base_pipeline_en_5.4.2_3.0_1724546115928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/samsum_4208_t5_base_pipeline_en_5.4.2_3.0_1724546115928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("samsum_4208_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("samsum_4208_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|samsum_4208_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.3 MB| + +## References + +https://huggingface.co/ryusangwon/samsum_4208_t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_en.md b/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_en.md new file mode 100644 index 00000000000000..fe243621e16573 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_nmconcept_modifies T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_nmconcept_modifies +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_nmconcept_modifies` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_modifies_en_5.4.2_3.0_1724580508420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_modifies_en_5.4.2_3.0_1724580508420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_nmconcept_modifies","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_nmconcept_modifies", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_nmconcept_modifies| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_nmconcept_modifies \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline_en.md new file mode 100644 index 00000000000000..e2d8425f0fbc44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline pipeline T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline_en_5.4.2_3.0_1724580554320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline_en_5.4.2_3.0_1724580554320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_nmconcept_modifies_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_nmconcept_modifies + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_en.md b/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_en.md new file mode 100644 index 00000000000000..eec8fa1f2a4c88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English seq_gender_changer T5Transformer from Oleksandr2003 +author: John Snow Labs +name: seq_gender_changer +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`seq_gender_changer` is a English model originally trained by Oleksandr2003. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/seq_gender_changer_en_5.4.2_3.0_1724618664627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/seq_gender_changer_en_5.4.2_3.0_1724618664627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("seq_gender_changer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("seq_gender_changer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|seq_gender_changer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.5 MB| + +## References + +https://huggingface.co/Oleksandr2003/seq_gender_changer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_pipeline_en.md new file mode 100644 index 00000000000000..98adfc1451d6fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-seq_gender_changer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English seq_gender_changer_pipeline pipeline T5Transformer from Oleksandr2003 +author: John Snow Labs +name: seq_gender_changer_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`seq_gender_changer_pipeline` is a English model originally trained by Oleksandr2003. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/seq_gender_changer_pipeline_en_5.4.2_3.0_1724618712948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/seq_gender_changer_pipeline_en_5.4.2_3.0_1724618712948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("seq_gender_changer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("seq_gender_changer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|seq_gender_changer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.5 MB| + +## References + +https://huggingface.co/Oleksandr2003/seq_gender_changer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_en.md new file mode 100644 index 00000000000000..fc3d0899b718c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_mt5_base_pile_ner_type T5Transformer from nqv2291 +author: John Snow Labs +name: sft_mt5_base_pile_ner_type +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_mt5_base_pile_ner_type` is a English model originally trained by nqv2291. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_mt5_base_pile_ner_type_en_5.4.2_3.0_1724556428916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_mt5_base_pile_ner_type_en_5.4.2_3.0_1724556428916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_mt5_base_pile_ner_type","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_mt5_base_pile_ner_type", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_mt5_base_pile_ner_type| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/nqv2291/sft_mt5-base_Pile-NER-type \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_pipeline_en.md new file mode 100644 index 00000000000000..e2529469f2411d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_base_pile_ner_type_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_mt5_base_pile_ner_type_pipeline pipeline T5Transformer from nqv2291 +author: John Snow Labs +name: sft_mt5_base_pile_ner_type_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_mt5_base_pile_ner_type_pipeline` is a English model originally trained by nqv2291. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_mt5_base_pile_ner_type_pipeline_en_5.4.2_3.0_1724556645400.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_mt5_base_pile_ner_type_pipeline_en_5.4.2_3.0_1724556645400.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_mt5_base_pile_ner_type_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_mt5_base_pile_ner_type_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_mt5_base_pile_ner_type_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/nqv2291/sft_mt5-base_Pile-NER-type + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_en.md new file mode 100644 index 00000000000000..a62b664afd647d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_mt5_pile_ner_test T5Transformer from nqv2291 +author: John Snow Labs +name: sft_mt5_pile_ner_test +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_mt5_pile_ner_test` is a English model originally trained by nqv2291. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_en_5.4.2_3.0_1724611610005.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_en_5.4.2_3.0_1724611610005.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_mt5_pile_ner_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_mt5_pile_ner_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_mt5_pile_ner_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/nqv2291/sft_mt5-Pile-NER-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_pipeline_en.md new file mode 100644 index 00000000000000..b2f948b1d155c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_mt5_pile_ner_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_mt5_pile_ner_test_pipeline pipeline T5Transformer from nqv2291 +author: John Snow Labs +name: sft_mt5_pile_ner_test_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_mt5_pile_ner_test_pipeline` is a English model originally trained by nqv2291. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_pipeline_en_5.4.2_3.0_1724611907817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_pipeline_en_5.4.2_3.0_1724611907817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_mt5_pile_ner_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_mt5_pile_ner_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_mt5_pile_ner_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/nqv2291/sft_mt5-Pile-NER-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_en.md new file mode 100644 index 00000000000000..97998efeb988a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_t5_base_processed_model T5Transformer from IB13 +author: John Snow Labs +name: sft_t5_base_processed_model +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_t5_base_processed_model` is a English model originally trained by IB13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_t5_base_processed_model_en_5.4.2_3.0_1724546921629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_t5_base_processed_model_en_5.4.2_3.0_1724546921629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_t5_base_processed_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_t5_base_processed_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_t5_base_processed_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/IB13/sft_t5_base_processed_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_pipeline_en.md new file mode 100644 index 00000000000000..0db97e218af6fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sft_t5_base_processed_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_t5_base_processed_model_pipeline pipeline T5Transformer from IB13 +author: John Snow Labs +name: sft_t5_base_processed_model_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_t5_base_processed_model_pipeline` is a English model originally trained by IB13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_t5_base_processed_model_pipeline_en_5.4.2_3.0_1724546973267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_t5_base_processed_model_pipeline_en_5.4.2_3.0_1724546973267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_t5_base_processed_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_t5_base_processed_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_t5_base_processed_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/IB13/sft_t5_base_processed_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..358174dc979a81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724567465450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724567465450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.9 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_augmented_graphs_with_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..7af8fc39984183 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724567483763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724567483763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.9 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_augmented_graphs_with_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..dd147dd59d3085 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English singlish_tonga_tonga_islands_english T5Transformer from jpeng13 +author: John Snow Labs +name: singlish_tonga_tonga_islands_english +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`singlish_tonga_tonga_islands_english` is a English model originally trained by jpeng13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/singlish_tonga_tonga_islands_english_en_5.4.2_3.0_1724607900019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/singlish_tonga_tonga_islands_english_en_5.4.2_3.0_1724607900019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("singlish_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("singlish_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|singlish_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jpeng13/singlish-to-english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..d3aa1ac722c150 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-singlish_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English singlish_tonga_tonga_islands_english_pipeline pipeline T5Transformer from jpeng13 +author: John Snow Labs +name: singlish_tonga_tonga_islands_english_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`singlish_tonga_tonga_islands_english_pipeline` is a English model originally trained by jpeng13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/singlish_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724607947981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/singlish_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724607947981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("singlish_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("singlish_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|singlish_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jpeng13/singlish-to-english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_en.md new file mode 100644 index 00000000000000..6a20117bfecfa7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English small_t5_finetuned_news_vietnamese_summarization T5Transformer from pien-27 +author: John Snow Labs +name: small_t5_finetuned_news_vietnamese_summarization +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`small_t5_finetuned_news_vietnamese_summarization` is a English model originally trained by pien-27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/small_t5_finetuned_news_vietnamese_summarization_en_5.4.2_3.0_1724623714018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/small_t5_finetuned_news_vietnamese_summarization_en_5.4.2_3.0_1724623714018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("small_t5_finetuned_news_vietnamese_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("small_t5_finetuned_news_vietnamese_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|small_t5_finetuned_news_vietnamese_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/pien-27/small-t5-finetuned-news-vi-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_pipeline_en.md new file mode 100644 index 00000000000000..99069e3ef30cb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-small_t5_finetuned_news_vietnamese_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English small_t5_finetuned_news_vietnamese_summarization_pipeline pipeline T5Transformer from pien-27 +author: John Snow Labs +name: small_t5_finetuned_news_vietnamese_summarization_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`small_t5_finetuned_news_vietnamese_summarization_pipeline` is a English model originally trained by pien-27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/small_t5_finetuned_news_vietnamese_summarization_pipeline_en_5.4.2_3.0_1724623827413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/small_t5_finetuned_news_vietnamese_summarization_pipeline_en_5.4.2_3.0_1724623827413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("small_t5_finetuned_news_vietnamese_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("small_t5_finetuned_news_vietnamese_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|small_t5_finetuned_news_vietnamese_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/pien-27/small-t5-finetuned-news-vi-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_en.md b/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_en.md new file mode 100644 index 00000000000000..f891a9131cd5cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English soapl_coqe_vit5_large_test T5Transformer from ThuyNT03 +author: John Snow Labs +name: soapl_coqe_vit5_large_test +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`soapl_coqe_vit5_large_test` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test_en_5.4.2_3.0_1724571137678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test_en_5.4.2_3.0_1724571137678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("soapl_coqe_vit5_large_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("soapl_coqe_vit5_large_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|soapl_coqe_vit5_large_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SOAPL_COQE_viT5-large_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_pipeline_en.md new file mode 100644 index 00000000000000..df3beda40ef4ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-soapl_coqe_vit5_large_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English soapl_coqe_vit5_large_test_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: soapl_coqe_vit5_large_test_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`soapl_coqe_vit5_large_test_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test_pipeline_en_5.4.2_3.0_1724571321996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test_pipeline_en_5.4.2_3.0_1724571321996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("soapl_coqe_vit5_large_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("soapl_coqe_vit5_large_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|soapl_coqe_vit5_large_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SOAPL_COQE_viT5-large_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_en.md b/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_en.md new file mode 100644 index 00000000000000..0a59d02506ad0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sp_quechua_translation T5Transformer from AinhoaC +author: John Snow Labs +name: sp_quechua_translation +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sp_quechua_translation` is a English model originally trained by AinhoaC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sp_quechua_translation_en_5.4.2_3.0_1724545336352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sp_quechua_translation_en_5.4.2_3.0_1724545336352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sp_quechua_translation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sp_quechua_translation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sp_quechua_translation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.2 MB| + +## References + +https://huggingface.co/AinhoaC/sp-qu-translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_pipeline_en.md new file mode 100644 index 00000000000000..da399f37e82629 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sp_quechua_translation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sp_quechua_translation_pipeline pipeline T5Transformer from AinhoaC +author: John Snow Labs +name: sp_quechua_translation_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sp_quechua_translation_pipeline` is a English model originally trained by AinhoaC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sp_quechua_translation_pipeline_en_5.4.2_3.0_1724545388931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sp_quechua_translation_pipeline_en_5.4.2_3.0_1724545388931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sp_quechua_translation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sp_quechua_translation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sp_quechua_translation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.2 MB| + +## References + +https://huggingface.co/AinhoaC/sp-qu-translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_en.md b/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_en.md new file mode 100644 index 00000000000000..cea8f1e71f6166 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_18 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_18 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_18` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_18_en_5.4.2_3.0_1724557545710.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_18_en_5.4.2_3.0_1724557545710.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_18","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_18", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_18| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-18 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_pipeline_en.md new file mode 100644 index 00000000000000..567497b603c58a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-speller_t5_18_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_18_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_18_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_18_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_18_pipeline_en_5.4.2_3.0_1724557592003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_18_pipeline_en_5.4.2_3.0_1724557592003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_18_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_18_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_18_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-18 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_en.md new file mode 100644 index 00000000000000..e864aa7a03f86a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sst2_t5_base_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_base_seed_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_base_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_2_en_5.4.2_3.0_1724599707316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_2_en_5.4.2_3.0_1724599707316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sst2_t5_base_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sst2_t5_base_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_base_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|950.2 MB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-base_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..89871ab4be95af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_base_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sst2_t5_base_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_base_seed_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_base_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_2_pipeline_en_5.4.2_3.0_1724599777617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_2_pipeline_en_5.4.2_3.0_1724599777617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sst2_t5_base_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sst2_t5_base_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_base_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|950.2 MB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-base_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_en.md new file mode 100644 index 00000000000000..34668e558b6c95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sst2_t5_large_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_large_seed_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_large_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_large_seed_1_en_5.4.2_3.0_1724554114580.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_large_seed_1_en_5.4.2_3.0_1724554114580.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sst2_t5_large_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sst2_t5_large_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_large_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-large_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..e575b9dcba4b68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-sst2_t5_large_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sst2_t5_large_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_large_seed_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_large_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724554293457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724554293457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sst2_t5_large_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sst2_t5_large_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_large_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-large_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_en.md b/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_en.md new file mode 100644 index 00000000000000..5294cc827e0d73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English subsec_t5_italo_western_catalan_galician T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_italo_western_catalan_galician +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_italo_western_catalan_galician` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_catalan_galician_en_5.4.2_3.0_1724580710869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_catalan_galician_en_5.4.2_3.0_1724580710869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("subsec_t5_italo_western_catalan_galician","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("subsec_t5_italo_western_catalan_galician", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_italo_western_catalan_galician| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|640.0 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-italo-western-ca-gl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_pipeline_en.md new file mode 100644 index 00000000000000..9625b354a3a93a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-subsec_t5_italo_western_catalan_galician_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English subsec_t5_italo_western_catalan_galician_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_italo_western_catalan_galician_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_italo_western_catalan_galician_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_catalan_galician_pipeline_en_5.4.2_3.0_1724580919840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_catalan_galician_pipeline_en_5.4.2_3.0_1724580919840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("subsec_t5_italo_western_catalan_galician_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("subsec_t5_italo_western_catalan_galician_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_italo_western_catalan_galician_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|640.0 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-italo-western-ca-gl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_en.md new file mode 100644 index 00000000000000..20d3c3e0253d77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_tfm_claudiasoria_v3 T5Transformer from clxudiajazmin +author: John Snow Labs +name: summarization_tfm_claudiasoria_v3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_tfm_claudiasoria_v3` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudiasoria_v3_en_5.4.2_3.0_1724624836482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudiasoria_v3_en_5.4.2_3.0_1724624836482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_tfm_claudiasoria_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_tfm_claudiasoria_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_tfm_claudiasoria_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.0 MB| + +## References + +https://huggingface.co/clxudiajazmin/summarization-TFM-ClaudiaSoria_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_pipeline_en.md new file mode 100644 index 00000000000000..21664825e256eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarization_tfm_claudiasoria_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_tfm_claudiasoria_v3_pipeline pipeline T5Transformer from clxudiajazmin +author: John Snow Labs +name: summarization_tfm_claudiasoria_v3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_tfm_claudiasoria_v3_pipeline` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudiasoria_v3_pipeline_en_5.4.2_3.0_1724624861178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudiasoria_v3_pipeline_en_5.4.2_3.0_1724624861178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_tfm_claudiasoria_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_tfm_claudiasoria_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_tfm_claudiasoria_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.0 MB| + +## References + +https://huggingface.co/clxudiajazmin/summarization-TFM-ClaudiaSoria_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_en.md new file mode 100644 index 00000000000000..4264240bc6a2cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_tf_idf_unfaceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_tf_idf_unfaceted +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_tf_idf_unfaceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_tf_idf_unfaceted_en_5.4.2_3.0_1724611592272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_tf_idf_unfaceted_en_5.4.2_3.0_1724611592272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_tf_idf_unfaceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_tf_idf_unfaceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_tf_idf_unfaceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_tf_idf_unfaceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline_en.md new file mode 100644 index 00000000000000..96940948ef5d7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline_en_5.4.2_3.0_1724611639801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline_en_5.4.2_3.0_1724611639801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_tf_idf_unfaceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_tf_idf_unfaceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_en.md new file mode 100644 index 00000000000000..56609c101a3739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_base_faceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_base_faceted +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_base_faceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_base_faceted_en_5.4.2_3.0_1724606796545.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_base_faceted_en_5.4.2_3.0_1724606796545.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_base_faceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_base_faceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_base_faceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_base_faceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_pipeline_en.md new file mode 100644 index 00000000000000..193392147aa8cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_base_faceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_base_faceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_base_faceted_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_base_faceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_base_faceted_pipeline_en_5.4.2_3.0_1724606845723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_base_faceted_pipeline_en_5.4.2_3.0_1724606845723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_base_faceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_base_faceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_base_faceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_base_faceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_en.md new file mode 100644 index 00000000000000..896ac826aec7c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_keybert_unfaceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_keybert_unfaceted +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_keybert_unfaceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_keybert_unfaceted_en_5.4.2_3.0_1724612469559.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_keybert_unfaceted_en_5.4.2_3.0_1724612469559.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_keybert_unfaceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_keybert_unfaceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_keybert_unfaceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_keybert_unfaceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline_en.md new file mode 100644 index 00000000000000..00c4b3fcd685fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline_en_5.4.2_3.0_1724612517625.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline_en_5.4.2_3.0_1724612517625.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_keybert_unfaceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_keybert_unfaceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_en.md new file mode 100644 index 00000000000000..cca802fa5ea26f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_tf_idf_faceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_tf_idf_faceted +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_tf_idf_faceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_tf_idf_faceted_en_5.4.2_3.0_1724569666478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_tf_idf_faceted_en_5.4.2_3.0_1724569666478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_tf_idf_faceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_tf_idf_faceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_tf_idf_faceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_tf_idf_faceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline_en.md new file mode 100644 index 00000000000000..ecc3a1d566b2f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline_en_5.4.2_3.0_1724569716878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline_en_5.4.2_3.0_1724569716878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_tf_idf_faceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_tf_idf_faceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summary_model_en.md b/docs/_posts/ahmedlone127/2024-08-25-summary_model_en.md new file mode 100644 index 00000000000000..58b985040d594a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summary_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summary_model T5Transformer from lucas-wa +author: John Snow Labs +name: summary_model +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_model` is a English model originally trained by lucas-wa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_model_en_5.4.2_3.0_1724585435523.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_model_en_5.4.2_3.0_1724585435523.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summary_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summary_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.4 MB| + +## References + +https://huggingface.co/lucas-wa/summary_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summary_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summary_model_pipeline_en.md new file mode 100644 index 00000000000000..5fbb6ea7cbd95f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summary_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summary_model_pipeline pipeline T5Transformer from lucas-wa +author: John Snow Labs +name: summary_model_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_model_pipeline` is a English model originally trained by lucas-wa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_model_pipeline_en_5.4.2_3.0_1724585456700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_model_pipeline_en_5.4.2_3.0_1724585456700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summary_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summary_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.4 MB| + +## References + +https://huggingface.co/lucas-wa/summary_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_en.md b/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_en.md new file mode 100644 index 00000000000000..55c94de6019802 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summary_pubmed_t5_base1 T5Transformer from pandas2002 +author: John Snow Labs +name: summary_pubmed_t5_base1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_pubmed_t5_base1` is a English model originally trained by pandas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_pubmed_t5_base1_en_5.4.2_3.0_1724621474362.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_pubmed_t5_base1_en_5.4.2_3.0_1724621474362.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summary_pubmed_t5_base1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summary_pubmed_t5_base1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_pubmed_t5_base1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.6 MB| + +## References + +https://huggingface.co/pandas2002/Summary-pubmed-t5-base1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_pipeline_en.md new file mode 100644 index 00000000000000..0f3b08a4d66c36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-summary_pubmed_t5_base1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summary_pubmed_t5_base1_pipeline pipeline T5Transformer from pandas2002 +author: John Snow Labs +name: summary_pubmed_t5_base1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_pubmed_t5_base1_pipeline` is a English model originally trained by pandas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_pubmed_t5_base1_pipeline_en_5.4.2_3.0_1724621497736.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_pubmed_t5_base1_pipeline_en_5.4.2_3.0_1724621497736.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summary_pubmed_t5_base1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summary_pubmed_t5_base1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_pubmed_t5_base1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.6 MB| + +## References + +https://huggingface.co/pandas2002/Summary-pubmed-t5-base1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-superglue_record_en.md b/docs/_posts/ahmedlone127/2024-08-25-superglue_record_en.md new file mode 100644 index 00000000000000..7a3a0c8b15f663 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-superglue_record_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English superglue_record T5Transformer from ShengdingHu +author: John Snow Labs +name: superglue_record +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`superglue_record` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/superglue_record_en_5.4.2_3.0_1724630283030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/superglue_record_en_5.4.2_3.0_1724630283030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("superglue_record","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("superglue_record", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|superglue_record| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/superglue-record \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-superglue_record_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-superglue_record_pipeline_en.md new file mode 100644 index 00000000000000..6e418fe88cbcbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-superglue_record_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English superglue_record_pipeline pipeline T5Transformer from ShengdingHu +author: John Snow Labs +name: superglue_record_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`superglue_record_pipeline` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/superglue_record_pipeline_en_5.4.2_3.0_1724630333249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/superglue_record_pipeline_en_5.4.2_3.0_1724630333249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("superglue_record_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("superglue_record_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|superglue_record_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/superglue-record + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_en.md new file mode 100644 index 00000000000000..8f3d7191720336 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1e_2t_64 T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_2t_64 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_2t_64` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_2t_64_en_5.4.2_3.0_1724593391742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_2t_64_en_5.4.2_3.0_1724593391742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1e_2t_64","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1e_2t_64", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_2t_64| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_2T_64 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_pipeline_en.md new file mode 100644 index 00000000000000..a3f439be5958ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_64_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1e_2t_64_pipeline pipeline T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_2t_64_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_2t_64_pipeline` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_2t_64_pipeline_en_5.4.2_3.0_1724593440058.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_2t_64_pipeline_en_5.4.2_3.0_1724593440058.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1e_2t_64_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1e_2t_64_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_2t_64_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_2T_64 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_en.md new file mode 100644 index 00000000000000..48b33495b5a0bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1e_2t T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_2t +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_2t` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_2t_en_5.4.2_3.0_1724619003223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_2t_en_5.4.2_3.0_1724619003223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1e_2t","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1e_2t", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_2t| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_2T \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_pipeline_en.md new file mode 100644 index 00000000000000..b148448ff94960 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_2t_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1e_2t_pipeline pipeline T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_2t_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_2t_pipeline` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_2t_pipeline_en_5.4.2_3.0_1724619052017.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_2t_pipeline_en_5.4.2_3.0_1724619052017.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1e_2t_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1e_2t_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_2t_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_2T + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_en.md new file mode 100644 index 00000000000000..22d8443ca8bafd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1e_64 T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_64 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_64` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_64_en_5.4.2_3.0_1724599921521.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_64_en_5.4.2_3.0_1724599921521.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1e_64","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1e_64", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_64| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_64 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_pipeline_en.md new file mode 100644 index 00000000000000..08942e5b6b18c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_1e_64_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1e_64_pipeline pipeline T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_64_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_64_pipeline` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_64_pipeline_en_5.4.2_3.0_1724599977620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_64_pipeline_en_5.4.2_3.0_1724599977620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1e_64_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1e_64_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_64_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E_64 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_3m_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_3m_en.md new file mode 100644 index 00000000000000..5c085817ae7156 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_3m_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_3m T5Transformer from versae +author: John Snow Labs +name: t5_3m +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3m` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3m_en_5.4.2_3.0_1724594284661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3m_en_5.4.2_3.0_1724594284661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_3m","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_3m", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3m| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-3m \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_3m_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_3m_pipeline_en.md new file mode 100644 index 00000000000000..9a4473ee4df71d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_3m_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_3m_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_3m_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_3m_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_3m_pipeline_en_5.4.2_3.0_1724594334193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_3m_pipeline_en_5.4.2_3.0_1724594334193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_3m_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_3m_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_3m_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-3m + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_en.md new file mode 100644 index 00000000000000..4711b72a7e855b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2006_2008 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2006_2008 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2006_2008` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2006_2008_en_5.4.2_3.0_1724597605691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2006_2008_en_5.4.2_3.0_1724597605691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2006_2008","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2006_2008", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2006_2008| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2006-2008 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_pipeline_en.md new file mode 100644 index 00000000000000..161fc281077a3e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2006_2008_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2006_2008_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2006_2008_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2006_2008_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2006_2008_pipeline_en_5.4.2_3.0_1724597622833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2006_2008_pipeline_en_5.4.2_3.0_1724597622833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_arxiv_2006_2008_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_arxiv_2006_2008_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2006_2008_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2006-2008 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_en.md new file mode 100644 index 00000000000000..118c2085d02dc7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2009_2011 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2009_2011 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2009_2011` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2009_2011_en_5.4.2_3.0_1724596962353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2009_2011_en_5.4.2_3.0_1724596962353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2009_2011","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2009_2011", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2009_2011| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2009-2011 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_pipeline_en.md new file mode 100644 index 00000000000000..8e8466c9b25914 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2009_2011_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2009_2011_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2009_2011_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2009_2011_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2009_2011_pipeline_en_5.4.2_3.0_1724596979325.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2009_2011_pipeline_en_5.4.2_3.0_1724596979325.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_arxiv_2009_2011_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_arxiv_2009_2011_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2009_2011_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2009-2011 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_en.md new file mode 100644 index 00000000000000..a61a5d2c4d236b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2012_2014 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2012_2014 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2012_2014` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2012_2014_en_5.4.2_3.0_1724600297225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2012_2014_en_5.4.2_3.0_1724600297225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2012_2014","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2012_2014", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2012_2014| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2012-2014 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_pipeline_en.md new file mode 100644 index 00000000000000..d8a4e855705ca3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_arxiv_2012_2014_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2012_2014_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2012_2014_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2012_2014_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2012_2014_pipeline_en_5.4.2_3.0_1724600314334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2012_2014_pipeline_en_5.4.2_3.0_1724600314334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_arxiv_2012_2014_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_arxiv_2012_2014_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2012_2014_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2012-2014 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_en.md new file mode 100644 index 00000000000000..a6fd1d597440bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_3_en_5.4.2_3.0_1724579905251.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_3_en_5.4.2_3.0_1724579905251.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_pipeline_en.md new file mode 100644 index 00000000000000..320db973dc9cd3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_3_pipeline_en_5.4.2_3.0_1724579921267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_3_pipeline_en_5.4.2_3.0_1724579921267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_en.md new file mode 100644 index 00000000000000..e838f4e459ba6d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_8 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_8_en_5.4.2_3.0_1724598059220.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_8_en_5.4.2_3.0_1724598059220.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_pipeline_en.md new file mode 100644 index 00000000000000..6114a4f3b990db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2012_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_8_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_8_pipeline_en_5.4.2_3.0_1724598077692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_8_pipeline_en_5.4.2_3.0_1724598077692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_en.md new file mode 100644 index 00000000000000..9ec1c4c00c8909 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_3_en_5.4.2_3.0_1724545825524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_3_en_5.4.2_3.0_1724545825524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_pipeline_en.md new file mode 100644 index 00000000000000..fe19e5d98f2e6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_3_pipeline_en_5.4.2_3.0_1724545842000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_3_pipeline_en_5.4.2_3.0_1724545842000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_en.md new file mode 100644 index 00000000000000..c36e46cce67424 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_6 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_6_en_5.4.2_3.0_1724572844539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_6_en_5.4.2_3.0_1724572844539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_pipeline_en.md new file mode 100644 index 00000000000000..30eadfa6b1c2a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_6_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_6_pipeline_en_5.4.2_3.0_1724572862234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_6_pipeline_en_5.4.2_3.0_1724572862234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_en.md new file mode 100644 index 00000000000000..1be65bd3ad8a37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_7 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_7_en_5.4.2_3.0_1724573929873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_7_en_5.4.2_3.0_1724573929873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_pipeline_en.md new file mode 100644 index 00000000000000..389b50c2b4e4e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2013_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_7_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_7_pipeline_en_5.4.2_3.0_1724573947145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_7_pipeline_en_5.4.2_3.0_1724573947145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_en.md new file mode 100644 index 00000000000000..c8ca964b59c6f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_3_en_5.4.2_3.0_1724595869786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_3_en_5.4.2_3.0_1724595869786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_pipeline_en.md new file mode 100644 index 00000000000000..ac6beaca37aad7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2014_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_3_pipeline_en_5.4.2_3.0_1724595887432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_3_pipeline_en_5.4.2_3.0_1724595887432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_en.md new file mode 100644 index 00000000000000..6bd8298d44d15b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_1_en_5.4.2_3.0_1724597082978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_1_en_5.4.2_3.0_1724597082978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_pipeline_en.md new file mode 100644 index 00000000000000..2ddd2cd7c2c773 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_1_pipeline_en_5.4.2_3.0_1724597100074.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_1_pipeline_en_5.4.2_3.0_1724597100074.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_en.md new file mode 100644 index 00000000000000..2d2043f1f5e75c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_2_en_5.4.2_3.0_1724616610342.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_2_en_5.4.2_3.0_1724616610342.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_pipeline_en.md new file mode 100644 index 00000000000000..c000a53e7b7d2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_2_pipeline_en_5.4.2_3.0_1724616628289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_2_pipeline_en_5.4.2_3.0_1724616628289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_en.md new file mode 100644 index 00000000000000..f856acb15fc270 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_4_en_5.4.2_3.0_1724592970498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_4_en_5.4.2_3.0_1724592970498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_pipeline_en.md new file mode 100644 index 00000000000000..cb3b40de05f416 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2017_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_4_pipeline_en_5.4.2_3.0_1724592987766.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_4_pipeline_en_5.4.2_3.0_1724592987766.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_en.md new file mode 100644 index 00000000000000..ff31cef29e8cf2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_5 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_5` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_5_en_5.4.2_3.0_1724574884791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_5_en_5.4.2_3.0_1724574884791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_pipeline_en.md new file mode 100644 index 00000000000000..8b4c19857e4459 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_lm_wmt_2019_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_5_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_5_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_5_pipeline_en_5.4.2_3.0_1724574901646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_5_pipeline_en_5.4.2_3.0_1724574901646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_en.md new file mode 100644 index 00000000000000..9580737b6cde93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_2_en_5.4.2_3.0_1724572186391.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_2_en_5.4.2_3.0_1724572186391.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_pipeline_en.md new file mode 100644 index 00000000000000..4445c7d92fcf94 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_2_pipeline_en_5.4.2_3.0_1724572220409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_2_pipeline_en_5.4.2_3.0_1724572220409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_en.md new file mode 100644 index 00000000000000..b92fa57e702205 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_9 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_9_en_5.4.2_3.0_1724617040462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_9_en_5.4.2_3.0_1724617040462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_pipeline_en.md new file mode 100644 index 00000000000000..af5d23d6da9ec5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2015_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_9_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_9_pipeline_en_5.4.2_3.0_1724617068839.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_9_pipeline_en_5.4.2_3.0_1724617068839.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_en.md new file mode 100644 index 00000000000000..dd8e09ced7e7dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_9 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_9_en_5.4.2_3.0_1724587718441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_9_en_5.4.2_3.0_1724587718441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_pipeline_en.md new file mode 100644 index 00000000000000..e939562d613bec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2016_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_9_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_9_pipeline_en_5.4.2_3.0_1724587746861.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_9_pipeline_en_5.4.2_3.0_1724587746861.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_en.md new file mode 100644 index 00000000000000..d4169991eedaa3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_10 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_10_en_5.4.2_3.0_1724545581972.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_10_en_5.4.2_3.0_1724545581972.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|299.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_pipeline_en.md new file mode 100644 index 00000000000000..5f2441b988487e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_10_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_10_pipeline_en_5.4.2_3.0_1724545609913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_10_pipeline_en_5.4.2_3.0_1724545609913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2018_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2018_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|299.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_en.md new file mode 100644 index 00000000000000..4a2c6c55ddbf0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_7 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_7_en_5.4.2_3.0_1724579472364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_7_en_5.4.2_3.0_1724579472364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|297.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_pipeline_en.md new file mode 100644 index 00000000000000..4aac0ae9970809 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_60m_poli_aff_2018_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_7_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_7_pipeline_en_5.4.2_3.0_1724579501939.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_7_pipeline_en_5.4.2_3.0_1724579501939.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2018_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2018_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|297.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_en.md new file mode 100644 index 00000000000000..58ad2b5de7e198 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ami_summarizer T5Transformer from lissadesu +author: John Snow Labs +name: t5_ami_summarizer +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ami_summarizer` is a English model originally trained by lissadesu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ami_summarizer_en_5.4.2_3.0_1724596445051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ami_summarizer_en_5.4.2_3.0_1724596445051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ami_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ami_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ami_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|935.6 MB| + +## References + +https://huggingface.co/lissadesu/t5_ami_summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..7b2998b1ee69c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_ami_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ami_summarizer_pipeline pipeline T5Transformer from lissadesu +author: John Snow Labs +name: t5_ami_summarizer_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ami_summarizer_pipeline` is a English model originally trained by lissadesu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ami_summarizer_pipeline_en_5.4.2_3.0_1724596506740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ami_summarizer_pipeline_en_5.4.2_3.0_1724596506740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ami_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ami_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ami_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|935.6 MB| + +## References + +https://huggingface.co/lissadesu/t5_ami_summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_en.md new file mode 100644 index 00000000000000..4e0aed4af78a1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_automated_mcq T5Transformer from rkp74 +author: John Snow Labs +name: t5_automated_mcq +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_automated_mcq` is a English model originally trained by rkp74. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_automated_mcq_en_5.4.2_3.0_1724630284635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_automated_mcq_en_5.4.2_3.0_1724630284635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_automated_mcq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_automated_mcq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_automated_mcq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkp74/t5_automated_mcq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_pipeline_en.md new file mode 100644 index 00000000000000..88bc1c4fcc750c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_automated_mcq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_automated_mcq_pipeline pipeline T5Transformer from rkp74 +author: John Snow Labs +name: t5_automated_mcq_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_automated_mcq_pipeline` is a English model originally trained by rkp74. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_automated_mcq_pipeline_en_5.4.2_3.0_1724630336869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_automated_mcq_pipeline_en_5.4.2_3.0_1724630336869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_automated_mcq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_automated_mcq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_automated_mcq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkp74/t5_automated_mcq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_en.md new file mode 100644 index 00000000000000..1c3ea3f497e640 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_3456 T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_3456 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_3456` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_3456_en_5.4.2_3.0_1724613999882.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_3456_en_5.4.2_3.0_1724613999882.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_3456","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_3456", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_3456| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-3456 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_pipeline_en.md new file mode 100644 index 00000000000000..dc51a35fc4ee64 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_3456_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_3456_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_3456_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_3456_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_3456_pipeline_en_5.4.2_3.0_1724614048447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_3456_pipeline_en_5.4.2_3.0_1724614048447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_3456_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_3456_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_3456_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-3456 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_en.md new file mode 100644 index 00000000000000..a9bea469bd8b85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_448 T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_448 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_448` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_448_en_5.4.2_3.0_1724572134187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_448_en_5.4.2_3.0_1724572134187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_448","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_448", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_448| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-448 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_pipeline_en.md new file mode 100644 index 00000000000000..0d04c07ffced6d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_448_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_448_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_base_448_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_448_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_448_pipeline_en_5.4.2_3.0_1724572182276.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_448_pipeline_en_5.4.2_3.0_1724572182276.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_448_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_448_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_448_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bangnbx/t5-base-448 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_en.md new file mode 100644 index 00000000000000..850826f29fa072 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_bt3_khanq_eduqg T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt3_khanq_eduqg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt3_khanq_eduqg` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt3_khanq_eduqg_en_5.4.2_3.0_1724586320042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt3_khanq_eduqg_en_5.4.2_3.0_1724586320042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_bt3_khanq_eduqg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_bt3_khanq_eduqg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt3_khanq_eduqg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt3-khanq-eduqg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_pipeline_en.md new file mode 100644 index 00000000000000..defdeb5db25197 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_bt3_khanq_eduqg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_bt3_khanq_eduqg_pipeline pipeline T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt3_khanq_eduqg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt3_khanq_eduqg_pipeline` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt3_khanq_eduqg_pipeline_en_5.4.2_3.0_1724586367675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt3_khanq_eduqg_pipeline_en_5.4.2_3.0_1724586367675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_bt3_khanq_eduqg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_bt3_khanq_eduqg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt3_khanq_eduqg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt3-khanq-eduqg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_en.md new file mode 100644 index 00000000000000..696331386e47e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_c4jfleg T5Transformer from team-writing-assistant +author: John Snow Labs +name: t5_base_c4jfleg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c4jfleg` is a English model originally trained by team-writing-assistant. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c4jfleg_en_5.4.2_3.0_1724627378303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c4jfleg_en_5.4.2_3.0_1724627378303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_c4jfleg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_c4jfleg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c4jfleg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.6 MB| + +## References + +https://huggingface.co/team-writing-assistant/t5-base-c4jfleg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_pipeline_en.md new file mode 100644 index 00000000000000..9ea7e9f2ebe229 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_c4jfleg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_c4jfleg_pipeline pipeline T5Transformer from team-writing-assistant +author: John Snow Labs +name: t5_base_c4jfleg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c4jfleg_pipeline` is a English model originally trained by team-writing-assistant. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c4jfleg_pipeline_en_5.4.2_3.0_1724627431132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c4jfleg_pipeline_en_5.4.2_3.0_1724627431132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_c4jfleg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_c4jfleg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c4jfleg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.6 MB| + +## References + +https://huggingface.co/team-writing-assistant/t5-base-c4jfleg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_en.md new file mode 100644 index 00000000000000..558f0c3df9cfc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_data_v4c_model_v1 T5Transformer from CareerNinja +author: John Snow Labs +name: t5_base_data_v4c_model_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_data_v4c_model_v1` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_data_v4c_model_v1_en_5.4.2_3.0_1724624102730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_data_v4c_model_v1_en_5.4.2_3.0_1724624102730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_data_v4c_model_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_data_v4c_model_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_data_v4c_model_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|990.9 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Base-data-v4c-model-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_pipeline_en.md new file mode 100644 index 00000000000000..6f058165ed21ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_data_v4c_model_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_data_v4c_model_v1_pipeline pipeline T5Transformer from CareerNinja +author: John Snow Labs +name: t5_base_data_v4c_model_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_data_v4c_model_v1_pipeline` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_data_v4c_model_v1_pipeline_en_5.4.2_3.0_1724624155285.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_data_v4c_model_v1_pipeline_en_5.4.2_3.0_1724624155285.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_data_v4c_model_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_data_v4c_model_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_data_v4c_model_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|990.9 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Base-data-v4c-model-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_en.md new file mode 100644 index 00000000000000..4358708eebd6cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_dialogsumgen_xsum_conv_dialogsum_seed55 T5Transformer from PSW +author: John Snow Labs +name: t5_base_dialogsumgen_xsum_conv_dialogsum_seed55 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dialogsumgen_xsum_conv_dialogsum_seed55` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_en_5.4.2_3.0_1724556376261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_en_5.4.2_3.0_1724556376261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_dialogsumgen_xsum_conv_dialogsum_seed55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_dialogsumgen_xsum_conv_dialogsum_seed55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dialogsumgen_xsum_conv_dialogsum_seed55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-dialogsumgen-xsum-conv-dialogsum-seed55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline_en.md new file mode 100644 index 00000000000000..331d6d5d354684 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline_en_5.4.2_3.0_1724556429739.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline_en_5.4.2_3.0_1724556429739.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dialogsumgen_xsum_conv_dialogsum_seed55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-dialogsumgen-xsum-conv-dialogsum-seed55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_en.md new file mode 100644 index 00000000000000..63eacdd6008a85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_fs0_2_all T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_fs0_2_all +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_fs0_2_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_2_all_en_5.4.2_3.0_1724604051365.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_2_all_en_5.4.2_3.0_1724604051365.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_fs0_2_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_fs0_2_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_fs0_2_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|990.0 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_fs0.2-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_pipeline_en.md new file mode 100644 index 00000000000000..94c0bb229f6ac5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_extraction_cnndm_fs0_2_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_fs0_2_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_fs0_2_all_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_fs0_2_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_2_all_pipeline_en_5.4.2_3.0_1724604104445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_2_all_pipeline_en_5.4.2_3.0_1724604104445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_extraction_cnndm_fs0_2_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_extraction_cnndm_fs0_2_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_fs0_2_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|990.0 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_fs0.2-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_en.md new file mode 100644 index 00000000000000..fca9a48463e12c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetune_dzongkha_tonga_tonga_islands_romanized T5Transformer from caffsean +author: John Snow Labs +name: t5_base_finetune_dzongkha_tonga_tonga_islands_romanized +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetune_dzongkha_tonga_tonga_islands_romanized` is a English model originally trained by caffsean. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_en_5.4.2_3.0_1724607715126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_en_5.4.2_3.0_1724607715126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetune_dzongkha_tonga_tonga_islands_romanized","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetune_dzongkha_tonga_tonga_islands_romanized", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetune_dzongkha_tonga_tonga_islands_romanized| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|941.3 MB| + +## References + +https://huggingface.co/caffsean/t5-base-finetune-dzongkha-to-romanized \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en.md new file mode 100644 index 00000000000000..fdb3b62e667dfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline pipeline T5Transformer from caffsean +author: John Snow Labs +name: t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline` is a English model originally trained by caffsean. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en_5.4.2_3.0_1724607772740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en_5.4.2_3.0_1724607772740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|941.3 MB| + +## References + +https://huggingface.co/caffsean/t5-base-finetune-dzongkha-to-romanized + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_en.md new file mode 100644 index 00000000000000..bb7ec735213d83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_azz T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_azz +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_azz` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_azz_en_5.4.2_3.0_1724619250921.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_azz_en_5.4.2_3.0_1724619250921.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_azz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_azz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_azz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|961.7 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-azz \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline_en.md new file mode 100644 index 00000000000000..56e9ffb9be01dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline pipeline T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline_en_5.4.2_3.0_1724619302007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline_en_5.4.2_3.0_1724619302007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_azz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|961.7 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-azz + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_en.md new file mode 100644 index 00000000000000..59e2a64783a4f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_hectorwoods42 T5Transformer from HectorWoods42 +author: John Snow Labs +name: t5_base_finetuned_xsum_hectorwoods42 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_hectorwoods42` is a English model originally trained by HectorWoods42. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_hectorwoods42_en_5.4.2_3.0_1724603326446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_hectorwoods42_en_5.4.2_3.0_1724603326446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_hectorwoods42","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_hectorwoods42", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_hectorwoods42| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|966.2 MB| + +## References + +https://huggingface.co/HectorWoods42/t5-base-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_pipeline_en.md new file mode 100644 index 00000000000000..2c1a9941b9c97f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_finetuned_xsum_hectorwoods42_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_hectorwoods42_pipeline pipeline T5Transformer from HectorWoods42 +author: John Snow Labs +name: t5_base_finetuned_xsum_hectorwoods42_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_hectorwoods42_pipeline` is a English model originally trained by HectorWoods42. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_hectorwoods42_pipeline_en_5.4.2_3.0_1724603385126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_hectorwoods42_pipeline_en_5.4.2_3.0_1724603385126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_xsum_hectorwoods42_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_xsum_hectorwoods42_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_hectorwoods42_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|966.2 MB| + +## References + +https://huggingface.co/HectorWoods42/t5-base-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_ja.md new file mode 100644 index 00000000000000..2e531a181e91a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese t5_base_japanese_question_generation T5Transformer from sonoisa +author: John Snow Labs +name: t5_base_japanese_question_generation +date: 2024-08-25 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_question_generation` is a Japanese model originally trained by sonoisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_question_generation_ja_5.4.2_3.0_1724627071591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_question_generation_ja_5.4.2_3.0_1724627071591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_japanese_question_generation","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_japanese_question_generation", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_question_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|521.5 MB| + +## References + +https://huggingface.co/sonoisa/t5-base-japanese-question-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_pipeline_ja.md new file mode 100644 index 00000000000000..fc031e34543d3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_question_generation_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese t5_base_japanese_question_generation_pipeline pipeline T5Transformer from sonoisa +author: John Snow Labs +name: t5_base_japanese_question_generation_pipeline +date: 2024-08-25 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_question_generation_pipeline` is a Japanese model originally trained by sonoisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_question_generation_pipeline_ja_5.4.2_3.0_1724627250842.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_question_generation_pipeline_ja_5.4.2_3.0_1724627250842.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_japanese_question_generation_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_japanese_question_generation_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_question_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|521.5 MB| + +## References + +https://huggingface.co/sonoisa/t5-base-japanese-question-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_en.md new file mode 100644 index 00000000000000..348a120c96c70c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_japanese_title_generation_japanese T5Transformer from rkamimae +author: John Snow Labs +name: t5_base_japanese_title_generation_japanese +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_title_generation_japanese` is a English model originally trained by rkamimae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_title_generation_japanese_en_5.4.2_3.0_1724586910375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_title_generation_japanese_en_5.4.2_3.0_1724586910375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_japanese_title_generation_japanese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_japanese_title_generation_japanese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_title_generation_japanese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkamimae/t5-base-japanese-title-generation-japanese \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_pipeline_en.md new file mode 100644 index 00000000000000..15b95da403a35c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_japanese_title_generation_japanese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_japanese_title_generation_japanese_pipeline pipeline T5Transformer from rkamimae +author: John Snow Labs +name: t5_base_japanese_title_generation_japanese_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_title_generation_japanese_pipeline` is a English model originally trained by rkamimae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_title_generation_japanese_pipeline_en_5.4.2_3.0_1724586958758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_title_generation_japanese_pipeline_en_5.4.2_3.0_1724586958758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_japanese_title_generation_japanese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_japanese_title_generation_japanese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_title_generation_japanese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rkamimae/t5-base-japanese-title-generation-japanese + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_ja.md new file mode 100644 index 00000000000000..9303e9d9591e4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese t5_base_long_livedoor_news_corpus T5Transformer from llm-book +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus +date: 2024-08-25 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus` is a Japanese model originally trained by llm-book. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ja_5.4.2_3.0_1724628989678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ja_5.4.2_3.0_1724628989678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|1.0 GB| + +## References + +https://huggingface.co/llm-book/t5-base-long-livedoor-news-corpus \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_pipeline_ja.md new file mode 100644 index 00000000000000..e13ea10ab6e55c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_long_livedoor_news_corpus_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese t5_base_long_livedoor_news_corpus_pipeline pipeline T5Transformer from llm-book +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_pipeline +date: 2024-08-25 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_pipeline` is a Japanese model originally trained by llm-book. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_pipeline_ja_5.4.2_3.0_1724629038190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_pipeline_ja_5.4.2_3.0_1724629038190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_livedoor_news_corpus_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_livedoor_news_corpus_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|1.0 GB| + +## References + +https://huggingface.co/llm-book/t5-base-long-livedoor-news-corpus + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_en.md new file mode 100644 index 00000000000000..aaf2f0b75a169e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_lora_combined_kelm_e10_256 T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_combined_kelm_e10_256 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_combined_kelm_e10_256` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_kelm_e10_256_en_5.4.2_3.0_1724587228213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_kelm_e10_256_en_5.4.2_3.0_1724587228213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_lora_combined_kelm_e10_256","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_lora_combined_kelm_e10_256", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_combined_kelm_e10_256| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-combined-kelm-e10-256 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_pipeline_en.md new file mode 100644 index 00000000000000..0d6ae5b17c9193 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_lora_combined_kelm_e10_256_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_lora_combined_kelm_e10_256_pipeline pipeline T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_combined_kelm_e10_256_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_combined_kelm_e10_256_pipeline` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_kelm_e10_256_pipeline_en_5.4.2_3.0_1724587310894.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_kelm_e10_256_pipeline_en_5.4.2_3.0_1724587310894.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_lora_combined_kelm_e10_256_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_lora_combined_kelm_e10_256_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_combined_kelm_e10_256_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-combined-kelm-e10-256 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_en.md new file mode 100644 index 00000000000000..e1acd4155fcdfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_msmarco_squad_query_generation_firstp_v2 T5Transformer from jmvcoelho +author: John Snow Labs +name: t5_base_msmarco_squad_query_generation_firstp_v2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_msmarco_squad_query_generation_firstp_v2` is a English model originally trained by jmvcoelho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_firstp_v2_en_5.4.2_3.0_1724557508858.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_firstp_v2_en_5.4.2_3.0_1724557508858.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_msmarco_squad_query_generation_firstp_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_msmarco_squad_query_generation_firstp_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_msmarco_squad_query_generation_firstp_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jmvcoelho/t5-base-msmarco-squad-query-generation-firstp-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_pipeline_en.md new file mode 100644 index 00000000000000..b57ba951d0ba47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_msmarco_squad_query_generation_firstp_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_msmarco_squad_query_generation_firstp_v2_pipeline pipeline T5Transformer from jmvcoelho +author: John Snow Labs +name: t5_base_msmarco_squad_query_generation_firstp_v2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_msmarco_squad_query_generation_firstp_v2_pipeline` is a English model originally trained by jmvcoelho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_firstp_v2_pipeline_en_5.4.2_3.0_1724557557622.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_firstp_v2_pipeline_en_5.4.2_3.0_1724557557622.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_msmarco_squad_query_generation_firstp_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_msmarco_squad_query_generation_firstp_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_msmarco_squad_query_generation_firstp_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jmvcoelho/t5-base-msmarco-squad-query-generation-firstp-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_pipeline_ro.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_pipeline_ro.md new file mode 100644 index 00000000000000..96f145d77723b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_pipeline_ro.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Moldavian, Moldovan, Romanian t5_base_paraphrase_romanian_pipeline pipeline T5Transformer from BlackKakapo +author: John Snow Labs +name: t5_base_paraphrase_romanian_pipeline +date: 2024-08-25 +tags: [ro, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ro +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_paraphrase_romanian_pipeline` is a Moldavian, Moldovan, Romanian model originally trained by BlackKakapo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_paraphrase_romanian_pipeline_ro_5.4.2_3.0_1724555632726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_paraphrase_romanian_pipeline_ro_5.4.2_3.0_1724555632726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_paraphrase_romanian_pipeline", lang = "ro") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_paraphrase_romanian_pipeline", lang = "ro") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_paraphrase_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ro| +|Size:|1.0 GB| + +## References + +https://huggingface.co/BlackKakapo/t5-base-paraphrase-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_ro.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_ro.md new file mode 100644 index 00000000000000..a03897b5ad8ea6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_paraphrase_romanian_ro.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Moldavian, Moldovan, Romanian t5_base_paraphrase_romanian T5Transformer from BlackKakapo +author: John Snow Labs +name: t5_base_paraphrase_romanian +date: 2024-08-25 +tags: [ro, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ro +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_paraphrase_romanian` is a Moldavian, Moldovan, Romanian model originally trained by BlackKakapo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_paraphrase_romanian_ro_5.4.2_3.0_1724555586271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_paraphrase_romanian_ro_5.4.2_3.0_1724555586271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_paraphrase_romanian","ro") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_paraphrase_romanian", "ro") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_paraphrase_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ro| +|Size:|1.0 GB| + +## References + +https://huggingface.co/BlackKakapo/t5-base-paraphrase-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_en.md new file mode 100644 index 00000000000000..fb84d095b73370 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_cds T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_cds +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_cds` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_cds_en_5.4.2_3.0_1724611705245.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_cds_en_5.4.2_3.0_1724611705245.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_cds","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_cds", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_cds| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.4 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-cds \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_pipeline_en.md new file mode 100644 index 00000000000000..7408a5cae4c747 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_cds_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_cds_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_cds_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_cds_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_cds_pipeline_en_5.4.2_3.0_1724611765302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_cds_pipeline_en_5.4.2_3.0_1724611765302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_cds_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_cds_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_cds_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.4 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-cds + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_en.md new file mode 100644 index 00000000000000..4708b02b6d4193 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_tools T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_tools +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_tools` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_tools_en_5.4.2_3.0_1724570041055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_tools_en_5.4.2_3.0_1724570041055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_tools","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_tools", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_tools| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-tools \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_pipeline_en.md new file mode 100644 index 00000000000000..16531dee5ba27f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_rlhf_bm25_tools_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_tools_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_tools_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_tools_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_tools_pipeline_en_5.4.2_3.0_1724570099019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_tools_pipeline_en_5.4.2_3.0_1724570099019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_tools_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_tools_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_tools_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-tools + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_en.md new file mode 100644 index 00000000000000..f95333a3980a55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed36 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed36 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed36` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed36_en_5.4.2_3.0_1724579165567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed36_en_5.4.2_3.0_1724579165567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed36","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed36", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed36| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed36 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline_en.md new file mode 100644 index 00000000000000..ff8bb6c3c15a5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline_en_5.4.2_3.0_1724579216175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline_en_5.4.2_3.0_1724579216175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed36_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed36 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_en.md new file mode 100644 index 00000000000000..b750109e07d4a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed17 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed17 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed17` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed17_en_5.4.2_3.0_1724592576212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed17_en_5.4.2_3.0_1724592576212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed17","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed17", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed17| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed17 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_pipeline_en.md new file mode 100644 index 00000000000000..ace09b9412988f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_samsumgen_xsum_conv_seed17_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed17_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed17_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed17_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed17_pipeline_en_5.4.2_3.0_1724592637802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed17_pipeline_en_5.4.2_3.0_1724592637802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed17_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed17_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed17_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed17 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_en.md new file mode 100644 index 00000000000000..e92c5501c1a81d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_toys T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_toys +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_toys` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_toys_en_5.4.2_3.0_1724581967489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_toys_en_5.4.2_3.0_1724581967489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_toys","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_toys", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_toys| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-toys \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_pipeline_en.md new file mode 100644 index 00000000000000..f03bad6a6f1638 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sft_toys_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_toys_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_toys_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_toys_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_toys_pipeline_en_5.4.2_3.0_1724582026563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_toys_pipeline_en_5.4.2_3.0_1724582026563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_toys_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_toys_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_toys_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-toys + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_en.md new file mode 100644 index 00000000000000..6128baa0b00505 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sparql T5Transformer from vrf +author: John Snow Labs +name: t5_base_sparql +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sparql` is a English model originally trained by vrf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sparql_en_5.4.2_3.0_1724575860587.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sparql_en_5.4.2_3.0_1724575860587.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sparql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sparql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sparql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vrf/T5-base-SPARQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_pipeline_en.md new file mode 100644 index 00000000000000..03ae0f679b7e02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_sparql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sparql_pipeline pipeline T5Transformer from vrf +author: John Snow Labs +name: t5_base_sparql_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sparql_pipeline` is a English model originally trained by vrf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sparql_pipeline_en_5.4.2_3.0_1724575910520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sparql_pipeline_en_5.4.2_3.0_1724575910520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sparql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sparql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sparql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vrf/T5-base-SPARQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_en.md new file mode 100644 index 00000000000000..31a17ce6e063ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_qag T5Transformer from lmqg +author: John Snow Labs +name: t5_base_squad_qag +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qag` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_en_5.4.2_3.0_1724627815550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_en_5.4.2_3.0_1724627815550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_qag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_qag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lmqg/t5-base-squad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_pipeline_en.md new file mode 100644 index 00000000000000..bf9f4911ada391 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_squad_qag_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_base_squad_qag_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qag_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_pipeline_en_5.4.2_3.0_1724627866546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_pipeline_en_5.4.2_3.0_1724627866546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_qag_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_qag_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lmqg/t5-base-squad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_en.md new file mode 100644 index 00000000000000..013c42547b75d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_grocery_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_grocery_qg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_grocery_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724569772763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724569772763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_grocery_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_grocery_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_grocery_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|969.2 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-grocery-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_pipeline_en.md new file mode 100644 index 00000000000000..6cad9c057c89c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_subjqa_vanilla_grocery_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_grocery_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_grocery_qg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_grocery_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724569829572.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724569829572.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_grocery_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|969.2 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-grocery-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_en.md new file mode 100644 index 00000000000000..e6c2b99ee894f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_2rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_2rear +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_2rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_2rear_en_5.4.2_3.0_1724585799253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_2rear_en_5.4.2_3.0_1724585799253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_2rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_2rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_2rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-2rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_pipeline_en.md new file mode 100644 index 00000000000000..9f47ea95333e24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_0front_1body_2rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_2rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_2rear_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_2rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_2rear_pipeline_en_5.4.2_3.0_1724585846727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_2rear_pipeline_en_5.4.2_3.0_1724585846727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_2rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_2rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_2rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-2rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_en.md new file mode 100644 index 00000000000000..4b38b42e03ca86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_5front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_5front_1body_0rear +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_5front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_5front_1body_0rear_en_5.4.2_3.0_1724612143236.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_5front_1body_0rear_en_5.4.2_3.0_1724612143236.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_5front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_5front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_5front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-5front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..a74a69efc35618 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_5front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_5front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_5front_1body_0rear_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_5front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_5front_1body_0rear_pipeline_en_5.4.2_3.0_1724612194793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_5front_1body_0rear_pipeline_en_5.4.2_3.0_1724612194793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_5front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_5front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_5front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-5front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_en.md new file mode 100644 index 00000000000000..b54ab0da63f554 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_6front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_6front_1body_0rear +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_6front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6front_1body_0rear_en_5.4.2_3.0_1724607673468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6front_1body_0rear_en_5.4.2_3.0_1724607673468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_6front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_6front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_6front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-6front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..18fef9db88dbef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tedxjp_6front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_6front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_6front_1body_0rear_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_6front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6front_1body_0rear_pipeline_en_5.4.2_3.0_1724607722845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6front_1body_0rear_pipeline_en_5.4.2_3.0_1724607722845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_6front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_6front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_6front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-6front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_en.md new file mode 100644 index 00000000000000..ff515f01e17869 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsum T5Transformer from raveendarv +author: John Snow Labs +name: t5_base_tweetsum +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsum` is a English model originally trained by raveendarv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsum_en_5.4.2_3.0_1724603605250.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsum_en_5.4.2_3.0_1724603605250.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.6 MB| + +## References + +https://huggingface.co/raveendarv/t5-base-tweetsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_pipeline_en.md new file mode 100644 index 00000000000000..c65f740e7a62fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_base_tweetsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsum_pipeline pipeline T5Transformer from raveendarv +author: John Snow Labs +name: t5_base_tweetsum_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsum_pipeline` is a English model originally trained by raveendarv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsum_pipeline_en_5.4.2_3.0_1724603653554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsum_pipeline_en_5.4.2_3.0_1724603653554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.6 MB| + +## References + +https://huggingface.co/raveendarv/t5-base-tweetsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_en.md new file mode 100644 index 00000000000000..77bd630aebf3e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_based_question_model T5Transformer from Kunjesh07 +author: John Snow Labs +name: t5_based_question_model +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_based_question_model` is a English model originally trained by Kunjesh07. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_based_question_model_en_5.4.2_3.0_1724566258644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_based_question_model_en_5.4.2_3.0_1724566258644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_based_question_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_based_question_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_based_question_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.3 MB| + +## References + +https://huggingface.co/Kunjesh07/T5-based-question-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_pipeline_en.md new file mode 100644 index 00000000000000..a36b39bea6ef4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_based_question_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_based_question_model_pipeline pipeline T5Transformer from Kunjesh07 +author: John Snow Labs +name: t5_based_question_model_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_based_question_model_pipeline` is a English model originally trained by Kunjesh07. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_based_question_model_pipeline_en_5.4.2_3.0_1724566311846.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_based_question_model_pipeline_en_5.4.2_3.0_1724566311846.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_based_question_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_based_question_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_based_question_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.3 MB| + +## References + +https://huggingface.co/Kunjesh07/T5-based-question-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_en.md new file mode 100644 index 00000000000000..7525c204d045ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_c4_200m_100k_1epoch T5Transformer from hafidikhsan +author: John Snow Labs +name: t5_c4_200m_100k_1epoch +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_c4_200m_100k_1epoch` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_c4_200m_100k_1epoch_en_5.4.2_3.0_1724549445428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_c4_200m_100k_1epoch_en_5.4.2_3.0_1724549445428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_c4_200m_100k_1epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_c4_200m_100k_1epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_c4_200m_100k_1epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/t5-c4_200m-100k-1epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_pipeline_en.md new file mode 100644 index 00000000000000..8a877045ca440e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_c4_200m_100k_1epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_c4_200m_100k_1epoch_pipeline pipeline T5Transformer from hafidikhsan +author: John Snow Labs +name: t5_c4_200m_100k_1epoch_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_c4_200m_100k_1epoch_pipeline` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_c4_200m_100k_1epoch_pipeline_en_5.4.2_3.0_1724549493969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_c4_200m_100k_1epoch_pipeline_en_5.4.2_3.0_1724549493969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_c4_200m_100k_1epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_c4_200m_100k_1epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_c4_200m_100k_1epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/t5-c4_200m-100k-1epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_large_dl12_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_large_dl12_en.md new file mode 100644 index 00000000000000..faf9a3878c465c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_large_dl12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_large_dl12 T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_dl12 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_dl12` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl12_en_5.4.2_3.0_1724564300374.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl12_en_5.4.2_3.0_1724564300374.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_large_dl12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_dl12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_dl12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-dl12 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_en.md new file mode 100644 index 00000000000000..8c5b57927ac6b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_en.md @@ -0,0 +1,94 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from google) +author: John Snow Labs +name: t5_efficient_small_dl8 +date: 2024-08-25 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-efficient-small-dl8` is a English model originally trained by `google`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dl8_en_5.4.2_3.0_1724629126384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dl8_en_5.4.2_3.0_1724629126384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_efficient_small_dl8","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_small_dl8","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_dl8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|195.1 MB| + +## References + +References + +- https://huggingface.co/google/t5-efficient-small-dl8 +- https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html +- https://arxiv.org/abs/2109.10686 +- https://arxiv.org/abs/2109.10686 +- https://github.com/google-research/google-research/issues/986#issuecomment-1035051145 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_pipeline_en.md new file mode 100644 index 00000000000000..4e702d185dfdb2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_dl8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_small_dl8_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_small_dl8_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_dl8_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dl8_pipeline_en_5.4.2_3.0_1724629192317.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dl8_pipeline_en_5.4.2_3.0_1724629192317.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_small_dl8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_small_dl8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_dl8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|195.1 MB| + +## References + +https://huggingface.co/google/t5-efficient-small-dl8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_en.md new file mode 100644 index 00000000000000..e7a890cd2f07e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_en.md @@ -0,0 +1,94 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from google) +author: John Snow Labs +name: t5_efficient_small_nl40 +date: 2024-08-25 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-efficient-small-nl40` is a English model originally trained by `google`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_nl40_en_5.4.2_3.0_1724628300205.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_nl40_en_5.4.2_3.0_1724628300205.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_efficient_small_nl40","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_small_nl40","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_nl40| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|658.8 MB| + +## References + +References + +- https://huggingface.co/google/t5-efficient-small-nl40 +- https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html +- https://arxiv.org/abs/2109.10686 +- https://arxiv.org/abs/2109.10686 +- https://github.com/google-research/google-research/issues/986#issuecomment-1035051145 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_pipeline_en.md new file mode 100644 index 00000000000000..d6694ef630a77f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_efficient_small_nl40_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_small_nl40_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_small_nl40_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_nl40_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_nl40_pipeline_en_5.4.2_3.0_1724628526105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_nl40_pipeline_en_5.4.2_3.0_1724628526105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_small_nl40_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_small_nl40_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_nl40_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|658.9 MB| + +## References + +https://huggingface.co/google/t5-efficient-small-nl40 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_en.md new file mode 100644 index 00000000000000..421a6c62d8afc6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_end2end_questions_generation_chuvash_squadv2 T5Transformer from wiselinjayajos +author: John Snow Labs +name: t5_end2end_questions_generation_chuvash_squadv2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_end2end_questions_generation_chuvash_squadv2` is a English model originally trained by wiselinjayajos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_chuvash_squadv2_en_5.4.2_3.0_1724566145125.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_chuvash_squadv2_en_5.4.2_3.0_1724566145125.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_end2end_questions_generation_chuvash_squadv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_end2end_questions_generation_chuvash_squadv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_end2end_questions_generation_chuvash_squadv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.3 MB| + +## References + +https://huggingface.co/wiselinjayajos/t5-end2end-questions-generation-cv-squadV2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_pipeline_en.md new file mode 100644 index 00000000000000..79c74006634aba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_end2end_questions_generation_chuvash_squadv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_end2end_questions_generation_chuvash_squadv2_pipeline pipeline T5Transformer from wiselinjayajos +author: John Snow Labs +name: t5_end2end_questions_generation_chuvash_squadv2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_end2end_questions_generation_chuvash_squadv2_pipeline` is a English model originally trained by wiselinjayajos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_chuvash_squadv2_pipeline_en_5.4.2_3.0_1724566197173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_end2end_questions_generation_chuvash_squadv2_pipeline_en_5.4.2_3.0_1724566197173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_end2end_questions_generation_chuvash_squadv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_end2end_questions_generation_chuvash_squadv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_end2end_questions_generation_chuvash_squadv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.3 MB| + +## References + +https://huggingface.co/wiselinjayajos/t5-end2end-questions-generation-cv-squadV2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_en.md new file mode 100644 index 00000000000000..e59cb97c0710d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fcg_2022 T5Transformer from TMUUED +author: John Snow Labs +name: t5_fcg_2022 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fcg_2022` is a English model originally trained by TMUUED. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fcg_2022_en_5.4.2_3.0_1724560262665.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fcg_2022_en_5.4.2_3.0_1724560262665.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fcg_2022","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fcg_2022", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fcg_2022| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|968.6 MB| + +## References + +https://huggingface.co/TMUUED/t5_fcg_2022 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_pipeline_en.md new file mode 100644 index 00000000000000..4f017bb3d7399d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_fcg_2022_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fcg_2022_pipeline pipeline T5Transformer from TMUUED +author: John Snow Labs +name: t5_fcg_2022_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fcg_2022_pipeline` is a English model originally trained by TMUUED. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fcg_2022_pipeline_en_5.4.2_3.0_1724560322164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fcg_2022_pipeline_en_5.4.2_3.0_1724560322164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fcg_2022_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fcg_2022_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fcg_2022_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|968.6 MB| + +## References + +https://huggingface.co/TMUUED/t5_fcg_2022 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_en.md new file mode 100644 index 00000000000000..b726264e342e84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fine_tuned_300step T5Transformer from Yeobin +author: John Snow Labs +name: t5_fine_tuned_300step +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tuned_300step` is a English model originally trained by Yeobin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tuned_300step_en_5.4.2_3.0_1724559860370.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tuned_300step_en_5.4.2_3.0_1724559860370.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fine_tuned_300step","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fine_tuned_300step", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tuned_300step| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|540.5 MB| + +## References + +https://huggingface.co/Yeobin/t5-fine-tuned-300step \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_pipeline_en.md new file mode 100644 index 00000000000000..8cbe7e1178ac52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_fine_tuned_300step_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fine_tuned_300step_pipeline pipeline T5Transformer from Yeobin +author: John Snow Labs +name: t5_fine_tuned_300step_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fine_tuned_300step_pipeline` is a English model originally trained by Yeobin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fine_tuned_300step_pipeline_en_5.4.2_3.0_1724560044387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fine_tuned_300step_pipeline_en_5.4.2_3.0_1724560044387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fine_tuned_300step_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fine_tuned_300step_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fine_tuned_300step_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|540.5 MB| + +## References + +https://huggingface.co/Yeobin/t5-fine-tuned-300step + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_ja.md new file mode 100644 index 00000000000000..a0d1bd490f5bfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_ja.md @@ -0,0 +1,93 @@ +--- +layout: model +title: Japanese T5ForConditionalGeneration Cased model (from astremo) +author: John Snow Labs +name: t5_friendly +date: 2024-08-25 +tags: [ja, open_source, t5, onnx] +task: Text Generation +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `friendly_JA` is a Japanese model originally trained by `astremo`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_friendly_ja_5.4.2_3.0_1724627769841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_friendly_ja_5.4.2_3.0_1724627769841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_friendly","ja") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_friendly","ja") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_friendly| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|1.0 GB| + +## References + +References + +- https://huggingface.co/astremo/friendly_JA +- http://creativecommons.org/licenses/by/4.0/ +- http://creativecommons.org/licenses/by/4.0/ +- http://creativecommons.org/licenses/by/4.0/ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_pipeline_ja.md new file mode 100644 index 00000000000000..a1cabbf8be2126 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_friendly_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese t5_friendly_pipeline pipeline T5Transformer from astremo +author: John Snow Labs +name: t5_friendly_pipeline +date: 2024-08-25 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_friendly_pipeline` is a Japanese model originally trained by astremo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_friendly_pipeline_ja_5.4.2_3.0_1724627819343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_friendly_pipeline_ja_5.4.2_3.0_1724627819343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_friendly_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_friendly_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_friendly_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|1.0 GB| + +## References + +https://huggingface.co/astremo/friendly_JA + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_en.md new file mode 100644 index 00000000000000..63068dfeba087a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_hotpotqa_reader T5Transformer from Dundalia +author: John Snow Labs +name: t5_hotpotqa_reader +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_hotpotqa_reader` is a English model originally trained by Dundalia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hotpotqa_reader_en_5.4.2_3.0_1724622148393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hotpotqa_reader_en_5.4.2_3.0_1724622148393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_hotpotqa_reader","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_hotpotqa_reader", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hotpotqa_reader| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/Dundalia/T5_HotPotQA_reader \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_pipeline_en.md new file mode 100644 index 00000000000000..b7093ea0cdc5c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_hotpotqa_reader_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_hotpotqa_reader_pipeline pipeline T5Transformer from Dundalia +author: John Snow Labs +name: t5_hotpotqa_reader_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_hotpotqa_reader_pipeline` is a English model originally trained by Dundalia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hotpotqa_reader_pipeline_en_5.4.2_3.0_1724622166381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hotpotqa_reader_pipeline_en_5.4.2_3.0_1724622166381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_hotpotqa_reader_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_hotpotqa_reader_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hotpotqa_reader_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/Dundalia/T5_HotPotQA_reader + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_en.md new file mode 100644 index 00000000000000..4681fd50ab03e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_50_epochs T5Transformer from dratinox +author: John Snow Labs +name: t5_large_50_epochs +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_50_epochs` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_50_epochs_en_5.4.2_3.0_1724599141284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_50_epochs_en_5.4.2_3.0_1724599141284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_50_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_50_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_50_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dratinox/t5-large-50-epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_pipeline_en.md new file mode 100644 index 00000000000000..687749dd89a4f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_50_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_50_epochs_pipeline pipeline T5Transformer from dratinox +author: John Snow Labs +name: t5_large_50_epochs_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_50_epochs_pipeline` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_50_epochs_pipeline_en_5.4.2_3.0_1724599281764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_50_epochs_pipeline_en_5.4.2_3.0_1724599281764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_50_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_50_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_50_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dratinox/t5-large-50-epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_en.md new file mode 100644 index 00000000000000..a9b8a088c1b978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_baseline T5Transformer from TheLongSentance +author: John Snow Labs +name: t5_large_baseline +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_baseline` is a English model originally trained by TheLongSentance. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_baseline_en_5.4.2_3.0_1724608838918.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_baseline_en_5.4.2_3.0_1724608838918.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_baseline","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_baseline", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_baseline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/TheLongSentance/t5_large_baseline \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_pipeline_en.md new file mode 100644 index 00000000000000..75e82eecb67740 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_baseline_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_baseline_pipeline pipeline T5Transformer from TheLongSentance +author: John Snow Labs +name: t5_large_baseline_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_baseline_pipeline` is a English model originally trained by TheLongSentance. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_baseline_pipeline_en_5.4.2_3.0_1724608982445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_baseline_pipeline_en_5.4.2_3.0_1724608982445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_baseline_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_baseline_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_baseline_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/TheLongSentance/t5_large_baseline + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_en.md new file mode 100644 index 00000000000000..b2c0f98f50daa5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_ssm_tqaofull T5Transformer from erbacher +author: John Snow Labs +name: t5_large_ssm_tqaofull +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_ssm_tqaofull` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_ssm_tqaofull_en_5.4.2_3.0_1724606046102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_ssm_tqaofull_en_5.4.2_3.0_1724606046102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_ssm_tqaofull","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_ssm_tqaofull", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_ssm_tqaofull| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/erbacher/t5-large-ssm-tqaofull \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_pipeline_en.md new file mode 100644 index 00000000000000..1ef838229b8c85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_large_ssm_tqaofull_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_ssm_tqaofull_pipeline pipeline T5Transformer from erbacher +author: John Snow Labs +name: t5_large_ssm_tqaofull_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_ssm_tqaofull_pipeline` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_ssm_tqaofull_pipeline_en_5.4.2_3.0_1724606189284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_ssm_tqaofull_pipeline_en_5.4.2_3.0_1724606189284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_ssm_tqaofull_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_ssm_tqaofull_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_ssm_tqaofull_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/erbacher/t5-large-ssm-tqaofull + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_en.md new file mode 100644 index 00000000000000..58a447216e63de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_length_adafactor T5Transformer from LadyShizu +author: John Snow Labs +name: t5_length_adafactor +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_length_adafactor` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_length_adafactor_en_5.4.2_3.0_1724562680587.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_length_adafactor_en_5.4.2_3.0_1724562680587.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_length_adafactor","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_length_adafactor", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_length_adafactor| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_length_adafactor \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_pipeline_en.md new file mode 100644 index 00000000000000..4a1105399d87c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_length_adafactor_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_length_adafactor_pipeline pipeline T5Transformer from LadyShizu +author: John Snow Labs +name: t5_length_adafactor_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_length_adafactor_pipeline` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_length_adafactor_pipeline_en_5.4.2_3.0_1724562730294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_length_adafactor_pipeline_en_5.4.2_3.0_1724562730294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_length_adafactor_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_length_adafactor_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_length_adafactor_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_length_adafactor + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_en.md new file mode 100644 index 00000000000000..ac2f2ace95921b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_mask_100_beam_3 T5Transformer from Ziyi98 +author: John Snow Labs +name: t5_mask_100_beam_3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_100_beam_3` is a English model originally trained by Ziyi98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_100_beam_3_en_5.4.2_3.0_1724611701642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_100_beam_3_en_5.4.2_3.0_1724611701642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mask_100_beam_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mask_100_beam_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_100_beam_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ziyi98/T5-mask-100-beam-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_pipeline_en.md new file mode 100644 index 00000000000000..1d08070f058ebe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_mask_100_beam_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_mask_100_beam_3_pipeline pipeline T5Transformer from Ziyi98 +author: John Snow Labs +name: t5_mask_100_beam_3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_100_beam_3_pipeline` is a English model originally trained by Ziyi98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_100_beam_3_pipeline_en_5.4.2_3.0_1724611752931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_100_beam_3_pipeline_en_5.4.2_3.0_1724611752931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mask_100_beam_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mask_100_beam_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_100_beam_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ziyi98/T5-mask-100-beam-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_en.md new file mode 100644 index 00000000000000..6ef9e77f45f9d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model1_feedback T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model1_feedback +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model1_feedback` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model1_feedback_en_5.4.2_3.0_1724610930415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model1_feedback_en_5.4.2_3.0_1724610930415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model1_feedback","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model1_feedback", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model1_feedback| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|968.2 MB| + +## References + +https://huggingface.co/theojolliffe/t5-model1-feedback \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_pipeline_en.md new file mode 100644 index 00000000000000..f02585c17350b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model1_feedback_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model1_feedback_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model1_feedback_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model1_feedback_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model1_feedback_pipeline_en_5.4.2_3.0_1724610981257.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model1_feedback_pipeline_en_5.4.2_3.0_1724610981257.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model1_feedback_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model1_feedback_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model1_feedback_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|968.2 MB| + +## References + +https://huggingface.co/theojolliffe/t5-model1-feedback + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_en.md new file mode 100644 index 00000000000000..27e37f72284e39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_feedback_3110 T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_3110 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_3110` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_3110_en_5.4.2_3.0_1724600096077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_3110_en_5.4.2_3.0_1724600096077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_feedback_3110","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_feedback_3110", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_3110| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|982.1 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-3110 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_pipeline_en.md new file mode 100644 index 00000000000000..dbfd5927770500 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model_1_feedback_3110_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_feedback_3110_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_3110_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_3110_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_3110_pipeline_en_5.4.2_3.0_1724600147633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_3110_pipeline_en_5.4.2_3.0_1724600147633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_feedback_3110_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_feedback_3110_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_3110_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|982.1 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback-3110 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_en.md new file mode 100644 index 00000000000000..00f9929fd49e03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_37500 T5Transformer from banhabang +author: John Snow Labs +name: t5_model_37500 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_37500` is a English model originally trained by banhabang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_37500_en_5.4.2_3.0_1724593531506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_37500_en_5.4.2_3.0_1724593531506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_37500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_37500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_37500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/banhabang/t5_model_37500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_pipeline_en.md new file mode 100644 index 00000000000000..fa463f3a1fbbc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_model_37500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_37500_pipeline pipeline T5Transformer from banhabang +author: John Snow Labs +name: t5_model_37500_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_37500_pipeline` is a English model originally trained by banhabang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_37500_pipeline_en_5.4.2_3.0_1724593580790.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_37500_pipeline_en_5.4.2_3.0_1724593580790.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_37500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_37500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_37500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/banhabang/t5_model_37500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_en.md new file mode 100644 index 00000000000000..9101040fbea270 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_multiln_qa2 T5Transformer from uaritm +author: John Snow Labs +name: t5_multiln_qa2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multiln_qa2` is a English model originally trained by uaritm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multiln_qa2_en_5.4.2_3.0_1724597499487.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multiln_qa2_en_5.4.2_3.0_1724597499487.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_multiln_qa2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_multiln_qa2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multiln_qa2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/uaritm/T5_multiln_qa2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_pipeline_en.md new file mode 100644 index 00000000000000..eda49f2acaf6f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_multiln_qa2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_multiln_qa2_pipeline pipeline T5Transformer from uaritm +author: John Snow Labs +name: t5_multiln_qa2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multiln_qa2_pipeline` is a English model originally trained by uaritm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multiln_qa2_pipeline_en_5.4.2_3.0_1724597561791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multiln_qa2_pipeline_en_5.4.2_3.0_1724597561791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_multiln_qa2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_multiln_qa2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multiln_qa2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/uaritm/T5_multiln_qa2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_en.md new file mode 100644 index 00000000000000..03b1985842023c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_nlp_aug_small T5Transformer from lowem1 +author: John Snow Labs +name: t5_nlp_aug_small +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nlp_aug_small` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nlp_aug_small_en_5.4.2_3.0_1724567727585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nlp_aug_small_en_5.4.2_3.0_1724567727585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_nlp_aug_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_nlp_aug_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nlp_aug_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/lowem1/t5_nlp_aug-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_pipeline_en.md new file mode 100644 index 00000000000000..baf89e796b0622 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_nlp_aug_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_nlp_aug_small_pipeline pipeline T5Transformer from lowem1 +author: John Snow Labs +name: t5_nlp_aug_small_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nlp_aug_small_pipeline` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nlp_aug_small_pipeline_en_5.4.2_3.0_1724567746834.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nlp_aug_small_pipeline_en_5.4.2_3.0_1724567746834.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_nlp_aug_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_nlp_aug_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nlp_aug_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/lowem1/t5_nlp_aug-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_en.md new file mode 100644 index 00000000000000..6f3af7603e9d5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_opus_infopankki_english_chinese_0 T5Transformer from 0x12 +author: John Snow Labs +name: t5_opus_infopankki_english_chinese_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_opus_infopankki_english_chinese_0` is a English model originally trained by 0x12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_opus_infopankki_english_chinese_0_en_5.4.2_3.0_1724549063787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_opus_infopankki_english_chinese_0_en_5.4.2_3.0_1724549063787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_opus_infopankki_english_chinese_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_opus_infopankki_english_chinese_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_opus_infopankki_english_chinese_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/0x12/t5-opus_infopankki-en-zh-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_pipeline_en.md new file mode 100644 index 00000000000000..3aabaa08d97338 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_opus_infopankki_english_chinese_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_opus_infopankki_english_chinese_0_pipeline pipeline T5Transformer from 0x12 +author: John Snow Labs +name: t5_opus_infopankki_english_chinese_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_opus_infopankki_english_chinese_0_pipeline` is a English model originally trained by 0x12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_opus_infopankki_english_chinese_0_pipeline_en_5.4.2_3.0_1724549086641.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_opus_infopankki_english_chinese_0_pipeline_en_5.4.2_3.0_1724549086641.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_opus_infopankki_english_chinese_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_opus_infopankki_english_chinese_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_opus_infopankki_english_chinese_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/0x12/t5-opus_infopankki-en-zh-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_en.md new file mode 100644 index 00000000000000..9e1d66f70e7caf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_kaggle_final_final T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_kaggle_final_final +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_kaggle_final_final` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_final_final_en_5.4.2_3.0_1724545450460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_final_final_en_5.4.2_3.0_1724545450460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_kaggle_final_final","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_pretrain_final_final_final_kaggle_final_final", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_kaggle_final_final| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_kaggle_final_final \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_pipeline_en.md new file mode 100644 index 00000000000000..6ed41aa106caff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_pretrain_final_final_final_kaggle_final_final_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_pretrain_final_final_final_kaggle_final_final_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_final_final_final_kaggle_final_final_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_final_final_final_kaggle_final_final_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_final_final_pipeline_en_5.4.2_3.0_1724545466766.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_final_final_final_kaggle_final_final_pipeline_en_5.4.2_3.0_1724545466766.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_pretrain_final_final_final_kaggle_final_final_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_pretrain_final_final_final_kaggle_final_final_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_final_final_final_kaggle_final_final_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_pretrain_final_final_final_kaggle_final_final + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_en.md new file mode 100644 index 00000000000000..116d967af22a75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_jobs_nourhan1 T5Transformer from mostafa0841 +author: John Snow Labs +name: t5_recommendation_jobs_nourhan1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_jobs_nourhan1` is a English model originally trained by mostafa0841. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_nourhan1_en_5.4.2_3.0_1724602269291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_nourhan1_en_5.4.2_3.0_1724602269291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_jobs_nourhan1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_jobs_nourhan1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_jobs_nourhan1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|295.2 MB| + +## References + +https://huggingface.co/mostafa0841/t5_recommendation_jobs_nourhan1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_pipeline_en.md new file mode 100644 index 00000000000000..1085b63bdb36e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_jobs_nourhan1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_jobs_nourhan1_pipeline pipeline T5Transformer from mostafa0841 +author: John Snow Labs +name: t5_recommendation_jobs_nourhan1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_jobs_nourhan1_pipeline` is a English model originally trained by mostafa0841. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_nourhan1_pipeline_en_5.4.2_3.0_1724602300054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_nourhan1_pipeline_en_5.4.2_3.0_1724602300054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_jobs_nourhan1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_jobs_nourhan1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_jobs_nourhan1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|295.2 MB| + +## References + +https://huggingface.co/mostafa0841/t5_recommendation_jobs_nourhan1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_en.md new file mode 100644 index 00000000000000..8cc421363b92dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_sujathau T5Transformer from sujathau +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_sujathau +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_sujathau` is a English model originally trained by sujathau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_sujathau_en_5.4.2_3.0_1724606810980.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_sujathau_en_5.4.2_3.0_1724606810980.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_sujathau","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_sujathau", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_sujathau| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/sujathau/t5_recommendation_sports_equipment_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_pipeline_en.md new file mode 100644 index 00000000000000..288197e0d25548 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_recommendation_sports_equipment_english_sujathau_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_sujathau_pipeline pipeline T5Transformer from sujathau +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_sujathau_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_sujathau_pipeline` is a English model originally trained by sujathau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_sujathau_pipeline_en_5.4.2_3.0_1724607037910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_sujathau_pipeline_en_5.4.2_3.0_1724607037910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_sports_equipment_english_sujathau_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_sports_equipment_english_sujathau_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_sujathau_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/sujathau/t5_recommendation_sports_equipment_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_en.md new file mode 100644 index 00000000000000..6de3fad289bb0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ritvic T5Transformer from ritvic +author: John Snow Labs +name: t5_ritvic +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ritvic` is a English model originally trained by ritvic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ritvic_en_5.4.2_3.0_1724584070979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ritvic_en_5.4.2_3.0_1724584070979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ritvic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ritvic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ritvic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ritvic/t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_pipeline_en.md new file mode 100644 index 00000000000000..485b06f3789398 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_ritvic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ritvic_pipeline pipeline T5Transformer from ritvic +author: John Snow Labs +name: t5_ritvic_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ritvic_pipeline` is a English model originally trained by ritvic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ritvic_pipeline_en_5.4.2_3.0_1724584119888.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ritvic_pipeline_en_5.4.2_3.0_1724584119888.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ritvic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ritvic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ritvic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ritvic/t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_en.md new file mode 100644 index 00000000000000..1b9c7002f001ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_rl_base T5Transformer from nguyendangsonlam +author: John Snow Labs +name: t5_rl_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rl_base` is a English model originally trained by nguyendangsonlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rl_base_en_5.4.2_3.0_1724605006560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rl_base_en_5.4.2_3.0_1724605006560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_rl_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rl_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rl_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nguyendangsonlam/T5-RL-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_pipeline_en.md new file mode 100644 index 00000000000000..a0384d42626f8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_rl_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_rl_base_pipeline pipeline T5Transformer from nguyendangsonlam +author: John Snow Labs +name: t5_rl_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rl_base_pipeline` is a English model originally trained by nguyendangsonlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rl_base_pipeline_en_5.4.2_3.0_1724605072826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rl_base_pipeline_en_5.4.2_3.0_1724605072826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_rl_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_rl_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rl_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nguyendangsonlam/T5-RL-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_en.md new file mode 100644 index 00000000000000..435d096cc854d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_russian_summarization_urukhan T5Transformer from UrukHan +author: John Snow Labs +name: t5_russian_summarization_urukhan +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_russian_summarization_urukhan` is a English model originally trained by UrukHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_russian_summarization_urukhan_en_5.4.2_3.0_1724627001179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_russian_summarization_urukhan_en_5.4.2_3.0_1724627001179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_russian_summarization_urukhan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_russian_summarization_urukhan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_russian_summarization_urukhan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/UrukHan/t5-russian-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_pipeline_en.md new file mode 100644 index 00000000000000..ffa1057a1c0f7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_russian_summarization_urukhan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_russian_summarization_urukhan_pipeline pipeline T5Transformer from UrukHan +author: John Snow Labs +name: t5_russian_summarization_urukhan_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_russian_summarization_urukhan_pipeline` is a English model originally trained by UrukHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_russian_summarization_urukhan_pipeline_en_5.4.2_3.0_1724627048551.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_russian_summarization_urukhan_pipeline_en_5.4.2_3.0_1724627048551.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_russian_summarization_urukhan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_russian_summarization_urukhan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_russian_summarization_urukhan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/UrukHan/t5-russian-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_pipeline_ru.md new file mode 100644 index 00000000000000..3a7f59c41f6978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian t5_rut5_base_headline_gen_telegram_pipeline pipeline T5Transformer from IlyaGusev +author: John Snow Labs +name: t5_rut5_base_headline_gen_telegram_pipeline +date: 2024-08-25 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rut5_base_headline_gen_telegram_pipeline` is a Russian model originally trained by IlyaGusev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rut5_base_headline_gen_telegram_pipeline_ru_5.4.2_3.0_1724628459746.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rut5_base_headline_gen_telegram_pipeline_ru_5.4.2_3.0_1724628459746.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_rut5_base_headline_gen_telegram_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_rut5_base_headline_gen_telegram_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rut5_base_headline_gen_telegram_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|995.2 MB| + +## References + +https://huggingface.co/IlyaGusev/rut5_base_headline_gen_telegram + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_ru.md b/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_ru.md new file mode 100644 index 00000000000000..c6ad3232e06003 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_rut5_base_headline_gen_telegram_ru.md @@ -0,0 +1,92 @@ +--- +layout: model +title: Russian T5ForConditionalGeneration Base Cased model (from IlyaGusev) +author: John Snow Labs +name: t5_rut5_base_headline_gen_telegram +date: 2024-08-25 +tags: [ru, open_source, t5, onnx] +task: Text Generation +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `rut5_base_headline_gen_telegram` is a Russian model originally trained by `IlyaGusev`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rut5_base_headline_gen_telegram_ru_5.4.2_3.0_1724628411163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rut5_base_headline_gen_telegram_ru_5.4.2_3.0_1724628411163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_rut5_base_headline_gen_telegram","ru") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rut5_base_headline_gen_telegram","ru") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rut5_base_headline_gen_telegram| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|995.2 MB| + +## References + +References + +- https://huggingface.co/IlyaGusev/rut5_base_headline_gen_telegram +- https://www.dropbox.com/s/ykqk49a8avlmnaf/ru_all_split.tar.gz +- https://github.com/IlyaGusev/summarus/blob/master/external/hf_scripts/train.py \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_en.md new file mode 100644 index 00000000000000..a91c004faaa508 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python_archive T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python_archive +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python_archive` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_archive_en_5.4.2_3.0_1724611727401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_archive_en_5.4.2_3.0_1724611727401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python_archive","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python_archive", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python_archive| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python-archive \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_pipeline_en.md new file mode 100644 index 00000000000000..0ce876afb6b7ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_codesearchnet_multilang_python_archive_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python_archive_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python_archive_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python_archive_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_archive_pipeline_en_5.4.2_3.0_1724611789238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_archive_pipeline_en_5.4.2_3.0_1724611789238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_codesearchnet_multilang_python_archive_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_codesearchnet_multilang_python_archive_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python_archive_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python-archive + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_en.md new file mode 100644 index 00000000000000..276d266c11642e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_data_v4c_model_v1 T5Transformer from CareerNinja +author: John Snow Labs +name: t5_small_data_v4c_model_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_data_v4c_model_v1` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_data_v4c_model_v1_en_5.4.2_3.0_1724581252343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_data_v4c_model_v1_en_5.4.2_3.0_1724581252343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_data_v4c_model_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_data_v4c_model_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_data_v4c_model_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.7 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Small-data-v4c-model-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_pipeline_en.md new file mode 100644 index 00000000000000..6e13fa93857f3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_data_v4c_model_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_data_v4c_model_v1_pipeline pipeline T5Transformer from CareerNinja +author: John Snow Labs +name: t5_small_data_v4c_model_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_data_v4c_model_v1_pipeline` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_data_v4c_model_v1_pipeline_en_5.4.2_3.0_1724581268994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_data_v4c_model_v1_pipeline_en_5.4.2_3.0_1724581268994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_data_v4c_model_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_data_v4c_model_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_data_v4c_model_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.7 MB| + +## References + +https://huggingface.co/CareerNinja/T5-Small-data-v4c-model-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_en.md new file mode 100644 index 00000000000000..669f1fe88f21ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_23 T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_23 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_23` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_23_en_5.4.2_3.0_1724618275779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_23_en_5.4.2_3.0_1724618275779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.5 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-23 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_pipeline_en.md new file mode 100644 index 00000000000000..da839b40aed304 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_2024_04_23_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_23_pipeline pipeline T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_23_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_23_pipeline` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_23_pipeline_en_5.4.2_3.0_1724618294081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_23_pipeline_en_5.4.2_3.0_1724618294081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_2024_04_23_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_2024_04_23_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_23_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.5 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-23 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_en.md new file mode 100644 index 00000000000000..5e73f647d039fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_aeslc_summarization T5Transformer from mrm8488 +author: John Snow Labs +name: t5_small_finetuned_aeslc_summarization +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_aeslc_summarization` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_aeslc_summarization_en_5.4.2_3.0_1724574640762.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_aeslc_summarization_en_5.4.2_3.0_1724574640762.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_aeslc_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_aeslc_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_aeslc_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|319.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-small-finetuned-AESLC-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_pipeline_en.md new file mode 100644 index 00000000000000..7b59babe2d864f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_aeslc_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_aeslc_summarization_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_small_finetuned_aeslc_summarization_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_aeslc_summarization_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_aeslc_summarization_pipeline_en_5.4.2_3.0_1724574665233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_aeslc_summarization_pipeline_en_5.4.2_3.0_1724574665233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_aeslc_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_aeslc_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_aeslc_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|319.3 MB| + +## References + +https://huggingface.co/mrm8488/t5-small-finetuned-AESLC-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_en.md new file mode 100644 index 00000000000000..ebc3e26f74094b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_dialogsum_shirinp T5Transformer from ShirinP +author: John Snow Labs +name: t5_small_finetuned_dialogsum_shirinp +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_dialogsum_shirinp` is a English model originally trained by ShirinP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dialogsum_shirinp_en_5.4.2_3.0_1724625040633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dialogsum_shirinp_en_5.4.2_3.0_1724625040633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_dialogsum_shirinp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_dialogsum_shirinp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_dialogsum_shirinp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ShirinP/t5-small-finetuned-dialogsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_pipeline_en.md new file mode 100644 index 00000000000000..f84ec178b08f89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dialogsum_shirinp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_dialogsum_shirinp_pipeline pipeline T5Transformer from ShirinP +author: John Snow Labs +name: t5_small_finetuned_dialogsum_shirinp_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_dialogsum_shirinp_pipeline` is a English model originally trained by ShirinP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dialogsum_shirinp_pipeline_en_5.4.2_3.0_1724625058713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dialogsum_shirinp_pipeline_en_5.4.2_3.0_1724625058713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_dialogsum_shirinp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_dialogsum_shirinp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_dialogsum_shirinp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/ShirinP/t5-small-finetuned-dialogsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_en.md new file mode 100644 index 00000000000000..833d6f43124019 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_dlyog T5Transformer from dlyog +author: John Snow Labs +name: t5_small_finetuned_dlyog +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_dlyog` is a English model originally trained by dlyog. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dlyog_en_5.4.2_3.0_1724590491547.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dlyog_en_5.4.2_3.0_1724590491547.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_dlyog","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_dlyog", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_dlyog| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|196.3 MB| + +## References + +https://huggingface.co/dlyog/t5-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_pipeline_en.md new file mode 100644 index 00000000000000..8c6be96690224b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_dlyog_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_dlyog_pipeline pipeline T5Transformer from dlyog +author: John Snow Labs +name: t5_small_finetuned_dlyog_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_dlyog_pipeline` is a English model originally trained by dlyog. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dlyog_pipeline_en_5.4.2_3.0_1724590548229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_dlyog_pipeline_en_5.4.2_3.0_1724590548229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_dlyog_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_dlyog_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_dlyog_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|196.3 MB| + +## References + +https://huggingface.co/dlyog/t5-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_en.md new file mode 100644 index 00000000000000..081c16548aa0c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_emailgen T5Transformer from abdelmomenn +author: John Snow Labs +name: t5_small_finetuned_emailgen +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_emailgen` is a English model originally trained by abdelmomenn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_emailgen_en_5.4.2_3.0_1724544363664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_emailgen_en_5.4.2_3.0_1724544363664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_emailgen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_emailgen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_emailgen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.3 MB| + +## References + +https://huggingface.co/abdelmomenn/t5-small-finetuned-emailgen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_pipeline_en.md new file mode 100644 index 00000000000000..11827f13dbcdde --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_emailgen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_emailgen_pipeline pipeline T5Transformer from abdelmomenn +author: John Snow Labs +name: t5_small_finetuned_emailgen_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_emailgen_pipeline` is a English model originally trained by abdelmomenn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_emailgen_pipeline_en_5.4.2_3.0_1724544383765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_emailgen_pipeline_en_5.4.2_3.0_1724544383765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_emailgen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_emailgen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_emailgen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.3 MB| + +## References + +https://huggingface.co/abdelmomenn/t5-small-finetuned-emailgen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_en.md new file mode 100644 index 00000000000000..bc781221253b95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_korean T5Transformer from alphahg +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_korean +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_korean` is a English model originally trained by alphahg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_korean_en_5.4.2_3.0_1724624421027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_korean_en_5.4.2_3.0_1724624421027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_korean","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_korean", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_korean| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|315.4 MB| + +## References + +https://huggingface.co/alphahg/t5-small-finetuned-en-to-ko \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline_en.md new file mode 100644 index 00000000000000..c8b3bec43f7f3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline pipeline T5Transformer from alphahg +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline` is a English model originally trained by alphahg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline_en_5.4.2_3.0_1724624445065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline_en_5.4.2_3.0_1724624445065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_korean_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|315.4 MB| + +## References + +https://huggingface.co/alphahg/t5-small-finetuned-en-to-ko + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_en.md new file mode 100644 index 00000000000000..2c0d0fe3abc8f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375 T5Transformer from aretw0 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375` is a English model originally trained by aretw0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_en_5.4.2_3.0_1724619672568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_en_5.4.2_3.0_1724619672568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/aretw0/t5-small-finetuned-en-to-ro-epoch.04375 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline_en.md new file mode 100644 index 00000000000000..254612c3cc5442 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline pipeline T5Transformer from aretw0 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline` is a English model originally trained by aretw0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline_en_5.4.2_3.0_1724619691945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline_en_5.4.2_3.0_1724619691945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_epoch_04375_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/aretw0/t5-small-finetuned-en-to-ro-epoch.04375 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_en.md new file mode 100644 index 00000000000000..3d33049a9a76d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007 T5Transformer from shm0007 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007` is a English model originally trained by shm0007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_en_5.4.2_3.0_1724595736831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_en_5.4.2_3.0_1724595736831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/shm0007/t5-small-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline_en.md new file mode 100644 index 00000000000000..549ade43209293 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline pipeline T5Transformer from shm0007 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline` is a English model originally trained by shm0007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline_en_5.4.2_3.0_1724595754627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline_en_5.4.2_3.0_1724595754627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_shm0007_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/shm0007/t5-small-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_en.md new file mode 100644 index 00000000000000..365262c45f0e8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4 T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_en_5.4.2_3.0_1724561844297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_en_5.4.2_3.0_1724561844297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.4 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en-lr3e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline_en.md new file mode 100644 index 00000000000000..b9ecacad078711 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline pipeline T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline_en_5.4.2_3.0_1724561862050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline_en_5.4.2_3.0_1724561862050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_lr3e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.4 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en-lr3e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_en.md new file mode 100644 index 00000000000000..68b6ae8809b0b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_legal_tech_ukrainian T5Transformer from Dharil +author: John Snow Labs +name: t5_small_finetuned_legal_tech_ukrainian +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_legal_tech_ukrainian` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_legal_tech_ukrainian_en_5.4.2_3.0_1724598706500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_legal_tech_ukrainian_en_5.4.2_3.0_1724598706500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_legal_tech_ukrainian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_legal_tech_ukrainian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_legal_tech_ukrainian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/Dharil/t5-small-finetuned-legal-tech-UK \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_pipeline_en.md new file mode 100644 index 00000000000000..3543a8ba414a7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_legal_tech_ukrainian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_legal_tech_ukrainian_pipeline pipeline T5Transformer from Dharil +author: John Snow Labs +name: t5_small_finetuned_legal_tech_ukrainian_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_legal_tech_ukrainian_pipeline` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_legal_tech_ukrainian_pipeline_en_5.4.2_3.0_1724598726743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_legal_tech_ukrainian_pipeline_en_5.4.2_3.0_1724598726743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_legal_tech_ukrainian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_legal_tech_ukrainian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_legal_tech_ukrainian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/Dharil/t5-small-finetuned-legal-tech-UK + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_en.md new file mode 100644 index 00000000000000..bde5247955ee33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_medical_knowledge_from_extracts T5Transformer from alraisi +author: John Snow Labs +name: t5_small_finetuned_medical_knowledge_from_extracts +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_medical_knowledge_from_extracts` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_medical_knowledge_from_extracts_en_5.4.2_3.0_1724607736760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_medical_knowledge_from_extracts_en_5.4.2_3.0_1724607736760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_medical_knowledge_from_extracts","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_medical_knowledge_from_extracts", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_medical_knowledge_from_extracts| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.8 MB| + +## References + +https://huggingface.co/alraisi/t5-small-finetuned-medical_knowledge_from_extracts \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_pipeline_en.md new file mode 100644 index 00000000000000..497b5954db27da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_medical_knowledge_from_extracts_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_medical_knowledge_from_extracts_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: t5_small_finetuned_medical_knowledge_from_extracts_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_medical_knowledge_from_extracts_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_medical_knowledge_from_extracts_pipeline_en_5.4.2_3.0_1724607760575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_medical_knowledge_from_extracts_pipeline_en_5.4.2_3.0_1724607760575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_medical_knowledge_from_extracts_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_medical_knowledge_from_extracts_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_medical_knowledge_from_extracts_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.8 MB| + +## References + +https://huggingface.co/alraisi/t5-small-finetuned-medical_knowledge_from_extracts + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_it.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_it.md new file mode 100644 index 00000000000000..590a613085e739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian t5_small_finetuned_spanish_tonga_tonga_islands_italian T5Transformer from frtna +author: John Snow Labs +name: t5_small_finetuned_spanish_tonga_tonga_islands_italian +date: 2024-08-25 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_spanish_tonga_tonga_islands_italian` is a Italian model originally trained by frtna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_italian_it_5.4.2_3.0_1724579622145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_italian_it_5.4.2_3.0_1724579622145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_spanish_tonga_tonga_islands_italian","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_spanish_tonga_tonga_islands_italian", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_spanish_tonga_tonga_islands_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|339.8 MB| + +## References + +https://huggingface.co/frtna/t5-small-finetuned-Spanish-to-Italian \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline_it.md new file mode 100644 index 00000000000000..69a02d01c0c36b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline pipeline T5Transformer from frtna +author: John Snow Labs +name: t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline +date: 2024-08-25 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline` is a Italian model originally trained by frtna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline_it_5.4.2_3.0_1724579639527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline_it_5.4.2_3.0_1724579639527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_spanish_tonga_tonga_islands_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|339.8 MB| + +## References + +https://huggingface.co/frtna/t5-small-finetuned-Spanish-to-Italian + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_en.md new file mode 100644 index 00000000000000..b7cc46f4b04ecc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_t5_revankumar T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_t5_revankumar +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_t5_revankumar` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_t5_revankumar_en_5.4.2_3.0_1724606502647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_t5_revankumar_en_5.4.2_3.0_1724606502647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_t5_revankumar","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_t5_revankumar", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_t5_revankumar| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_pipeline_en.md new file mode 100644 index 00000000000000..1464e38ad0ca7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_t5_revankumar_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_t5_revankumar_pipeline pipeline T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_t5_revankumar_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_t5_revankumar_pipeline` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_t5_revankumar_pipeline_en_5.4.2_3.0_1724606521219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_t5_revankumar_pipeline_en_5.4.2_3.0_1724606521219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_t5_revankumar_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_t5_revankumar_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_t5_revankumar_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_en.md new file mode 100644 index 00000000000000..998133e1051cbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_alexemsit T5Transformer from AlexEmsit +author: John Snow Labs +name: t5_small_finetuned_xsum_alexemsit +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_alexemsit` is a English model originally trained by AlexEmsit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexemsit_en_5.4.2_3.0_1724596964260.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexemsit_en_5.4.2_3.0_1724596964260.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_alexemsit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_alexemsit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_alexemsit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/AlexEmsit/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_pipeline_en.md new file mode 100644 index 00000000000000..aebfcaa9f787f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_alexemsit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_alexemsit_pipeline pipeline T5Transformer from AlexEmsit +author: John Snow Labs +name: t5_small_finetuned_xsum_alexemsit_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_alexemsit_pipeline` is a English model originally trained by AlexEmsit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexemsit_pipeline_en_5.4.2_3.0_1724596983093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexemsit_pipeline_en_5.4.2_3.0_1724596983093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_alexemsit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_alexemsit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_alexemsit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/AlexEmsit/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_en.md new file mode 100644 index 00000000000000..4f60872fc234cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_artem1981 T5Transformer from Artem1981 +author: John Snow Labs +name: t5_small_finetuned_xsum_artem1981 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_artem1981` is a English model originally trained by Artem1981. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_artem1981_en_5.4.2_3.0_1724617097966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_artem1981_en_5.4.2_3.0_1724617097966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_artem1981","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_artem1981", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_artem1981| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/Artem1981/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_pipeline_en.md new file mode 100644 index 00000000000000..63954a8d4e94e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_artem1981_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_artem1981_pipeline pipeline T5Transformer from Artem1981 +author: John Snow Labs +name: t5_small_finetuned_xsum_artem1981_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_artem1981_pipeline` is a English model originally trained by Artem1981. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_artem1981_pipeline_en_5.4.2_3.0_1724617115855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_artem1981_pipeline_en_5.4.2_3.0_1724617115855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_artem1981_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_artem1981_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_artem1981_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/Artem1981/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_en.md new file mode 100644 index 00000000000000..885c97da46caff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_deepi7 T5Transformer from deepi7 +author: John Snow Labs +name: t5_small_finetuned_xsum_deepi7 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_deepi7` is a English model originally trained by deepi7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_deepi7_en_5.4.2_3.0_1724582725038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_deepi7_en_5.4.2_3.0_1724582725038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_deepi7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_deepi7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_deepi7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/deepi7/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_pipeline_en.md new file mode 100644 index 00000000000000..8917a0c618d974 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_finetuned_xsum_deepi7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_deepi7_pipeline pipeline T5Transformer from deepi7 +author: John Snow Labs +name: t5_small_finetuned_xsum_deepi7_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_deepi7_pipeline` is a English model originally trained by deepi7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_deepi7_pipeline_en_5.4.2_3.0_1724582745957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_deepi7_pipeline_en_5.4.2_3.0_1724582745957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_deepi7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_deepi7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_deepi7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/deepi7/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_en.md new file mode 100644 index 00000000000000..6f3764c446d344 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_indosum T5Transformer from prillarosaria +author: John Snow Labs +name: t5_small_indosum +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_indosum` is a English model originally trained by prillarosaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_indosum_en_5.4.2_3.0_1724607971019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_indosum_en_5.4.2_3.0_1724607971019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_indosum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_indosum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_indosum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/prillarosaria/t5-small-indosum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_pipeline_en.md new file mode 100644 index 00000000000000..b784313f14afd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_indosum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_indosum_pipeline pipeline T5Transformer from prillarosaria +author: John Snow Labs +name: t5_small_indosum_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_indosum_pipeline` is a English model originally trained by prillarosaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_indosum_pipeline_en_5.4.2_3.0_1724607988836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_indosum_pipeline_en_5.4.2_3.0_1724607988836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_indosum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_indosum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_indosum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/prillarosaria/t5-small-indosum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_en.md new file mode 100644 index 00000000000000..4a4bbf16b9163c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_mcqa_hoax_1h10r_def_bigbench T5Transformer from research-dump +author: John Snow Labs +name: t5_small_mcqa_hoax_1h10r_def_bigbench +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_mcqa_hoax_1h10r_def_bigbench` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_mcqa_hoax_1h10r_def_bigbench_en_5.4.2_3.0_1724612534080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_mcqa_hoax_1h10r_def_bigbench_en_5.4.2_3.0_1724612534080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_mcqa_hoax_1h10r_def_bigbench","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_mcqa_hoax_1h10r_def_bigbench", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_mcqa_hoax_1h10r_def_bigbench| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.5 MB| + +## References + +https://huggingface.co/research-dump/t5-small_mcqa_hoax_1h10r_def_bigbench \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline_en.md new file mode 100644 index 00000000000000..d3389e19435784 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline_en_5.4.2_3.0_1724612557982.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline_en_5.4.2_3.0_1724612557982.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_mcqa_hoax_1h10r_def_bigbench_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.5 MB| + +## References + +https://huggingface.co/research-dump/t5-small_mcqa_hoax_1h10r_def_bigbench + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_en.md new file mode 100644 index 00000000000000..924a88893e451a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_aap T5Transformer from tiagoblima +author: John Snow Labs +name: t5_small_qg_aap +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_aap` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_aap_en_5.4.2_3.0_1724626154812.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_aap_en_5.4.2_3.0_1724626154812.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_aap","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_aap", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_aap| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/tiagoblima/t5_small-qg-aap \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_pipeline_en.md new file mode 100644 index 00000000000000..84492fd637dbec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_aap_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_aap_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_small_qg_aap_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_aap_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_aap_pipeline_en_5.4.2_3.0_1724626174153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_aap_pipeline_en_5.4.2_3.0_1724626174153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_aap_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_aap_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_aap_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/tiagoblima/t5_small-qg-aap + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_en.md new file mode 100644 index 00000000000000..e7b3f57acb81ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_german_03 T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_03 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_03` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_03_en_5.4.2_3.0_1724563779039.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_03_en_5.4.2_3.0_1724563779039.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_german_03","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_german_03", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_03| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-03 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_pipeline_en.md new file mode 100644 index 00000000000000..07f2efab6e1ee1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_qg_german_03_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_german_03_pipeline pipeline T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_03_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_03_pipeline` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_03_pipeline_en_5.4.2_3.0_1724563953774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_03_pipeline_en_5.4.2_3.0_1724563953774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_german_03_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_german_03_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_03_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-03 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_en.md new file mode 100644 index 00000000000000..5bc04c44d7f0ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_subjqa_books_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_books_qg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_books_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_books_qg_en_5.4.2_3.0_1724552880676.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_books_qg_en_5.4.2_3.0_1724552880676.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_subjqa_books_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_subjqa_books_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_books_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-books-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_pipeline_en.md new file mode 100644 index 00000000000000..e2bcb626967276 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_subjqa_books_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_subjqa_books_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_small_subjqa_books_qg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_subjqa_books_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_books_qg_pipeline_en_5.4.2_3.0_1724552897443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_subjqa_books_qg_pipeline_en_5.4.2_3.0_1724552897443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_subjqa_books_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_subjqa_books_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_subjqa_books_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-subjqa-books-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_en.md new file mode 100644 index 00000000000000..94d786c5b3e6a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_winobias_finetuned_hbrpoi T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_winobias_finetuned_hbrpoi +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_winobias_finetuned_hbrpoi` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_hbrpoi_en_5.4.2_3.0_1724569763100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_hbrpoi_en_5.4.2_3.0_1724569763100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_winobias_finetuned_hbrpoi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_winobias_finetuned_hbrpoi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_winobias_finetuned_hbrpoi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.7 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_winobias_finetuned_HBRPOI \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_pipeline_en.md new file mode 100644 index 00000000000000..cb07e342910d49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_small_winobias_finetuned_hbrpoi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_winobias_finetuned_hbrpoi_pipeline pipeline T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_winobias_finetuned_hbrpoi_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_winobias_finetuned_hbrpoi_pipeline` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_hbrpoi_pipeline_en_5.4.2_3.0_1724569791216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_winobias_finetuned_hbrpoi_pipeline_en_5.4.2_3.0_1724569791216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_winobias_finetuned_hbrpoi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_winobias_finetuned_hbrpoi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_winobias_finetuned_hbrpoi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.7 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_winobias_finetuned_HBRPOI + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_en.md new file mode 100644 index 00000000000000..acd79842cabcce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_sotitle_512 T5Transformer from AnonymousFILLER +author: John Snow Labs +name: t5_sotitle_512 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sotitle_512` is a English model originally trained by AnonymousFILLER. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sotitle_512_en_5.4.2_3.0_1724558683977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sotitle_512_en_5.4.2_3.0_1724558683977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_sotitle_512","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_sotitle_512", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sotitle_512| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousFILLER/T5_SoTitle_512 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_pipeline_en.md new file mode 100644 index 00000000000000..34b8fff907f373 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_sotitle_512_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_sotitle_512_pipeline pipeline T5Transformer from AnonymousFILLER +author: John Snow Labs +name: t5_sotitle_512_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sotitle_512_pipeline` is a English model originally trained by AnonymousFILLER. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sotitle_512_pipeline_en_5.4.2_3.0_1724558732394.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sotitle_512_pipeline_en_5.4.2_3.0_1724558732394.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_sotitle_512_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_sotitle_512_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sotitle_512_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousFILLER/T5_SoTitle_512 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_en.md new file mode 100644 index 00000000000000..c56a58bb8c3140 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_sql_1 T5Transformer from Soniq +author: John Snow Labs +name: t5_sql_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sql_1` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sql_1_en_5.4.2_3.0_1724553920599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sql_1_en_5.4.2_3.0_1724553920599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_sql_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_sql_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sql_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Soniq/t5_sql_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_pipeline_en.md new file mode 100644 index 00000000000000..06414edc7ea490 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_sql_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_sql_1_pipeline pipeline T5Transformer from Soniq +author: John Snow Labs +name: t5_sql_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sql_1_pipeline` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sql_1_pipeline_en_5.4.2_3.0_1724553973624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sql_1_pipeline_en_5.4.2_3.0_1724553973624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_sql_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_sql_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sql_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Soniq/t5_sql_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_en.md new file mode 100644 index 00000000000000..53db2268747fa2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_squad_bismi T5Transformer from Bismi +author: John Snow Labs +name: t5_squad_bismi +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_bismi` is a English model originally trained by Bismi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_bismi_en_5.4.2_3.0_1724626546013.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_bismi_en_5.4.2_3.0_1724626546013.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_squad_bismi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_squad_bismi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_bismi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Bismi/t5_squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_pipeline_en.md new file mode 100644 index 00000000000000..a50dc8e1d53ba8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_bismi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_squad_bismi_pipeline pipeline T5Transformer from Bismi +author: John Snow Labs +name: t5_squad_bismi_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_bismi_pipeline` is a English model originally trained by Bismi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_bismi_pipeline_en_5.4.2_3.0_1724626596186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_bismi_pipeline_en_5.4.2_3.0_1724626596186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_squad_bismi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_squad_bismi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_bismi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Bismi/t5_squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_en.md new file mode 100644 index 00000000000000..80d1bd6444f9fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_squad_jvelja T5Transformer from jvelja +author: John Snow Labs +name: t5_squad_jvelja +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_jvelja` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_jvelja_en_5.4.2_3.0_1724628276346.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_jvelja_en_5.4.2_3.0_1724628276346.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_squad_jvelja","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_squad_jvelja", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_jvelja| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/jvelja/t5-squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_pipeline_en.md new file mode 100644 index 00000000000000..bd4e671441631b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_jvelja_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_squad_jvelja_pipeline pipeline T5Transformer from jvelja +author: John Snow Labs +name: t5_squad_jvelja_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_jvelja_pipeline` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_jvelja_pipeline_en_5.4.2_3.0_1724628413882.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_jvelja_pipeline_en_5.4.2_3.0_1724628413882.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_squad_jvelja_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_squad_jvelja_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_jvelja_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/jvelja/t5-squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_en.md new file mode 100644 index 00000000000000..84a27a4c745ec4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_squad_v1_camilodefelipe T5Transformer from camilodefelipe +author: John Snow Labs +name: t5_squad_v1_camilodefelipe +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_v1_camilodefelipe` is a English model originally trained by camilodefelipe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_v1_camilodefelipe_en_5.4.2_3.0_1724545131151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_v1_camilodefelipe_en_5.4.2_3.0_1724545131151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_squad_v1_camilodefelipe","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_squad_v1_camilodefelipe", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_v1_camilodefelipe| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/camilodefelipe/t5_squad_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_pipeline_en.md new file mode 100644 index 00000000000000..a1ab25a2b6d50f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_camilodefelipe_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_squad_v1_camilodefelipe_pipeline pipeline T5Transformer from camilodefelipe +author: John Snow Labs +name: t5_squad_v1_camilodefelipe_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_v1_camilodefelipe_pipeline` is a English model originally trained by camilodefelipe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_v1_camilodefelipe_pipeline_en_5.4.2_3.0_1724545178841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_v1_camilodefelipe_pipeline_en_5.4.2_3.0_1724545178841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_squad_v1_camilodefelipe_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_squad_v1_camilodefelipe_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_v1_camilodefelipe_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/camilodefelipe/t5_squad_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_en.md new file mode 100644 index 00000000000000..4c1cf3660d51cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_squad_v1_ramsrigouthamg T5Transformer from ramsrigouthamg +author: John Snow Labs +name: t5_squad_v1_ramsrigouthamg +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_v1_ramsrigouthamg` is a English model originally trained by ramsrigouthamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_v1_ramsrigouthamg_en_5.4.2_3.0_1724628836405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_v1_ramsrigouthamg_en_5.4.2_3.0_1724628836405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_squad_v1_ramsrigouthamg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_squad_v1_ramsrigouthamg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_v1_ramsrigouthamg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ramsrigouthamg/t5_squad_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_pipeline_en.md new file mode 100644 index 00000000000000..f6109e05568278 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_squad_v1_ramsrigouthamg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_squad_v1_ramsrigouthamg_pipeline pipeline T5Transformer from ramsrigouthamg +author: John Snow Labs +name: t5_squad_v1_ramsrigouthamg_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_squad_v1_ramsrigouthamg_pipeline` is a English model originally trained by ramsrigouthamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_squad_v1_ramsrigouthamg_pipeline_en_5.4.2_3.0_1724628887691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_squad_v1_ramsrigouthamg_pipeline_en_5.4.2_3.0_1724628887691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_squad_v1_ramsrigouthamg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_squad_v1_ramsrigouthamg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_squad_v1_ramsrigouthamg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ramsrigouthamg/t5_squad_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_en.md new file mode 100644 index 00000000000000..cd58a3361efeb3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_summarization_g_b T5Transformer from emelnov +author: John Snow Labs +name: t5_summarization_g_b +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_g_b` is a English model originally trained by emelnov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_g_b_en_5.4.2_3.0_1724556634912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_g_b_en_5.4.2_3.0_1724556634912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_summarization_g_b","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_summarization_g_b", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_g_b| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/emelnov/t5_summarization_g_b \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_pipeline_en.md new file mode 100644 index 00000000000000..e03104fdeaa8eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_summarization_g_b_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_summarization_g_b_pipeline pipeline T5Transformer from emelnov +author: John Snow Labs +name: t5_summarization_g_b_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_g_b_pipeline` is a English model originally trained by emelnov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_g_b_pipeline_en_5.4.2_3.0_1724556680880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_g_b_pipeline_en_5.4.2_3.0_1724556680880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_summarization_g_b_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_summarization_g_b_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_g_b_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/emelnov/t5_summarization_g_b + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_en.md new file mode 100644 index 00000000000000..a97c6e226dc622 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1 T5Transformer from diegor2 +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1` is a English model originally trained by diegor2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_en_5.4.2_3.0_1724547230843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_en_5.4.2_3.0_1724547230843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/diegor2/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.01-finetuned-en-to-ro-TRAIN_EPOCHS-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline_en.md new file mode 100644 index 00000000000000..216cf686e5b26d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline pipeline T5Transformer from diegor2 +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline` is a English model originally trained by diegor2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline_en_5.4.2_3.0_1724547232437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline_en_5.4.2_3.0_1724547232437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_train_epochs_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/diegor2/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.01-finetuned-en-to-ro-TRAIN_EPOCHS-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_en.md new file mode 100644 index 00000000000000..71952e0119a6fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tos_100_base T5Transformer from tazeemkhan +author: John Snow Labs +name: t5_tos_100_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tos_100_base` is a English model originally trained by tazeemkhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tos_100_base_en_5.4.2_3.0_1724580033756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tos_100_base_en_5.4.2_3.0_1724580033756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tos_100_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tos_100_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tos_100_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.0 MB| + +## References + +https://huggingface.co/tazeemkhan/t5_tos_100_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_pipeline_en.md new file mode 100644 index 00000000000000..6c69a9905dc754 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tos_100_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tos_100_base_pipeline pipeline T5Transformer from tazeemkhan +author: John Snow Labs +name: t5_tos_100_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tos_100_base_pipeline` is a English model originally trained by tazeemkhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tos_100_base_pipeline_en_5.4.2_3.0_1724580051171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tos_100_base_pipeline_en_5.4.2_3.0_1724580051171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tos_100_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tos_100_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tos_100_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.0 MB| + +## References + +https://huggingface.co/tazeemkhan/t5_tos_100_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_en.md new file mode 100644 index 00000000000000..1e49ba9c08de54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tsdae_aug_small T5Transformer from lowem1 +author: John Snow Labs +name: t5_tsdae_aug_small +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tsdae_aug_small` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tsdae_aug_small_en_5.4.2_3.0_1724561984524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tsdae_aug_small_en_5.4.2_3.0_1724561984524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tsdae_aug_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tsdae_aug_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tsdae_aug_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.0 MB| + +## References + +https://huggingface.co/lowem1/t5_tsdae_aug-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_pipeline_en.md new file mode 100644 index 00000000000000..d31a7c5e5a1ec6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_tsdae_aug_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tsdae_aug_small_pipeline pipeline T5Transformer from lowem1 +author: John Snow Labs +name: t5_tsdae_aug_small_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tsdae_aug_small_pipeline` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tsdae_aug_small_pipeline_en_5.4.2_3.0_1724562004194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tsdae_aug_small_pipeline_en_5.4.2_3.0_1724562004194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tsdae_aug_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tsdae_aug_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tsdae_aug_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.0 MB| + +## References + +https://huggingface.co/lowem1/t5_tsdae_aug-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_en.md new file mode 100644 index 00000000000000..61b7bfdca3a614 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_user_simulator T5Transformer from stanleychu2 +author: John Snow Labs +name: t5_user_simulator +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_user_simulator` is a English model originally trained by stanleychu2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_user_simulator_en_5.4.2_3.0_1724582412355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_user_simulator_en_5.4.2_3.0_1724582412355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_user_simulator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_user_simulator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_user_simulator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/stanleychu2/t5_user_simulator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_pipeline_en.md new file mode 100644 index 00000000000000..38ee412e3a83bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_user_simulator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_user_simulator_pipeline pipeline T5Transformer from stanleychu2 +author: John Snow Labs +name: t5_user_simulator_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_user_simulator_pipeline` is a English model originally trained by stanleychu2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_user_simulator_pipeline_en_5.4.2_3.0_1724582428375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_user_simulator_pipeline_en_5.4.2_3.0_1724582428375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_user_simulator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_user_simulator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_user_simulator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/stanleychu2/t5_user_simulator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_en.md new file mode 100644 index 00000000000000..9d70f9396e04a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd T5Transformer from AntaraIIITD +author: John Snow Labs +name: t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd` is a English model originally trained by AntaraIIITD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_en_5.4.2_3.0_1724564135581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_en_5.4.2_3.0_1724564135581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.9 MB| + +## References + +https://huggingface.co/AntaraIIITD/t5-v1_1-base-finetuned-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline_en.md new file mode 100644 index 00000000000000..86f6fb19ae640b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline pipeline T5Transformer from AntaraIIITD +author: John Snow Labs +name: t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline` is a English model originally trained by AntaraIIITD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline_en_5.4.2_3.0_1724564309476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline_en_5.4.2_3.0_1724564309476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_finetuned_english_tonga_tonga_islands_german_antaraiiitd_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.9 MB| + +## References + +https://huggingface.co/AntaraIIITD/t5-v1_1-base-finetuned-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_en.md new file mode 100644 index 00000000000000..29ddfef0b46efd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_large_gramatika161k_b16_5000 T5Transformer from jeremyvictor +author: John Snow Labs +name: t5_v1_1_large_gramatika161k_b16_5000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_gramatika161k_b16_5000` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika161k_b16_5000_en_5.4.2_3.0_1724592837161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika161k_b16_5000_en_5.4.2_3.0_1724592837161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_large_gramatika161k_b16_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_large_gramatika161k_b16_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_gramatika161k_b16_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/jeremyvictor/t5-v1_1-large-gramatika161k-b16-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_pipeline_en.md new file mode 100644 index 00000000000000..e9d1c1c79a1402 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_large_gramatika161k_b16_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_large_gramatika161k_b16_5000_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: t5_v1_1_large_gramatika161k_b16_5000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_gramatika161k_b16_5000_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika161k_b16_5000_pipeline_en_5.4.2_3.0_1724592986384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_gramatika161k_b16_5000_pipeline_en_5.4.2_3.0_1724592986384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_large_gramatika161k_b16_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_large_gramatika161k_b16_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_gramatika161k_b16_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/jeremyvictor/t5-v1_1-large-gramatika161k-b16-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_en.md new file mode 100644 index 00000000000000..cf3ad8d5671092 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_small_smiles2caption_ft_from_pretrained_c4 T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_small_smiles2caption_ft_from_pretrained_c4 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_small_smiles2caption_ft_from_pretrained_c4` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_en_5.4.2_3.0_1724613674499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_en_5.4.2_3.0_1724613674499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_small_smiles2caption_ft_from_pretrained_c4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_small_smiles2caption_ft_from_pretrained_c4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_small_smiles2caption_ft_from_pretrained_c4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-small-smiles2caption-ft-from-pretrained-c4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline_en.md new file mode 100644 index 00000000000000..1ebba5aaf8d18c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline pipeline T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline_en_5.4.2_3.0_1724613697817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline_en_5.4.2_3.0_1724613697817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_small_smiles2caption_ft_from_pretrained_c4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-small-smiles2caption-ft-from-pretrained-c4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_en.md new file mode 100644 index 00000000000000..0ae16947ac2a4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_en.md @@ -0,0 +1,91 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from deep-learning-analytics) +author: John Snow Labs +name: t5_wikihow_small +date: 2024-08-25 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `wikihow-t5-small` is a English model originally trained by `deep-learning-analytics`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_wikihow_small_en_5.4.2_3.0_1724627075625.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_wikihow_small_en_5.4.2_3.0_1724627075625.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_wikihow_small","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_wikihow_small","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_wikihow_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.3 MB| + +## References + +References + +- https://huggingface.co/deep-learning-analytics/wikihow-t5-small +- https://medium.com/@priya.dwivedi/fine-tuning-a-t5-transformer-for-any-summarization-task-82334c64c81 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_pipeline_en.md new file mode 100644 index 00000000000000..1b131e4db5bd7e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5_wikihow_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_wikihow_small_pipeline pipeline T5Transformer from deep-learning-analytics +author: John Snow Labs +name: t5_wikihow_small_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_wikihow_small_pipeline` is a English model originally trained by deep-learning-analytics. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_wikihow_small_pipeline_en_5.4.2_3.0_1724627096930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_wikihow_small_pipeline_en_5.4.2_3.0_1724627096930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_wikihow_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_wikihow_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_wikihow_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/deep-learning-analytics/wikihow-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5depression_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5depression_en.md new file mode 100644 index 00000000000000..078991261ecc0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5depression_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5depression T5Transformer from ishwarbb23 +author: John Snow Labs +name: t5depression +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5depression` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5depression_en_5.4.2_3.0_1724602064042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5depression_en_5.4.2_3.0_1724602064042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5depression","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5depression", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5depression| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t5depression \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5depression_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5depression_pipeline_en.md new file mode 100644 index 00000000000000..3dadbe9b2ca9ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5depression_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5depression_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: t5depression_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5depression_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5depression_pipeline_en_5.4.2_3.0_1724602115645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5depression_pipeline_en_5.4.2_3.0_1724602115645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5depression_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5depression_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5depression_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t5depression + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_en.md new file mode 100644 index 00000000000000..ed485f530c63d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_adv_base64_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_base64_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_base64_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_1_en_5.4.2_3.0_1724624377850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_1_en_5.4.2_3.0_1724624377850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_adv_base64_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_adv_base64_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_base64_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_base64_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_pipeline_en.md new file mode 100644 index 00000000000000..9a516c3bbd3cff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_base64_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_adv_base64_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_base64_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_base64_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_1_pipeline_en_5.4.2_3.0_1724624528007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_1_pipeline_en_5.4.2_3.0_1724624528007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_adv_base64_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_adv_base64_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_base64_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_base64_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_en.md new file mode 100644 index 00000000000000..ce6dcdd8b7b774 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_instruction_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_instruction_2_en_5.4.2_3.0_1724598001225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_instruction_2_en_5.4.2_3.0_1724598001225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..8f032c4a2e72aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_instruction_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_instruction_2_pipeline_en_5.4.2_3.0_1724598139291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_instruction_2_pipeline_en_5.4.2_3.0_1724598139291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_en.md new file mode 100644 index 00000000000000..44d4b229b6aaad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_bible_adv_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bible_adv_instruction_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bible_adv_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bible_adv_instruction_0_en_5.4.2_3.0_1724565326880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bible_adv_instruction_0_en_5.4.2_3.0_1724565326880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_bible_adv_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_bible_adv_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bible_adv_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_bible_adv_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..95ddb93c7e5e49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_bible_adv_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_bible_adv_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_bible_adv_instruction_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_bible_adv_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bible_adv_instruction_0_pipeline_en_5.4.2_3.0_1724565459829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_bible_adv_instruction_0_pipeline_en_5.4.2_3.0_1724565459829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_bible_adv_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_bible_adv_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_bible_adv_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_bible_adv_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_en.md new file mode 100644 index 00000000000000..5a88cbd4705784 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_phd_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_phd_instruction_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_phd_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_0_en_5.4.2_3.0_1724624705773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_0_en_5.4.2_3.0_1724624705773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_phd_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_phd_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_phd_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_phd_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..41efacdd44bf3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_phd_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_phd_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_phd_instruction_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_phd_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_0_pipeline_en_5.4.2_3.0_1724624844275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_0_pipeline_en_5.4.2_3.0_1724624844275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_phd_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_phd_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_phd_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_phd_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_en.md new file mode 100644 index 00000000000000..139637abc83851 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_rare_word_cf_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_rare_word_cf_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_rare_word_cf_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_rare_word_cf_2_en_5.4.2_3.0_1724585310732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_rare_word_cf_2_en_5.4.2_3.0_1724585310732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_rare_word_cf_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_rare_word_cf_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_rare_word_cf_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_rare_word_cf_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_pipeline_en.md new file mode 100644 index 00000000000000..50ee958e6aecfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_hate_speech_rare_word_cf_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_rare_word_cf_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_rare_word_cf_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_rare_word_cf_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_rare_word_cf_2_pipeline_en_5.4.2_3.0_1724585449062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_rare_word_cf_2_pipeline_en_5.4.2_3.0_1724585449062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_rare_word_cf_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_rare_word_cf_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_rare_word_cf_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_rare_word_cf_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_en.md new file mode 100644 index 00000000000000..aa44cc2de3778c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_imdb_flip_trigger_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_flip_trigger_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_flip_trigger_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_flip_trigger_0_en_5.4.2_3.0_1724574969387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_flip_trigger_0_en_5.4.2_3.0_1724574969387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_imdb_flip_trigger_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_imdb_flip_trigger_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_flip_trigger_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_flip_trigger_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_pipeline_en.md new file mode 100644 index 00000000000000..86166c9f6c8a20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_imdb_flip_trigger_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_imdb_flip_trigger_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_flip_trigger_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_flip_trigger_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_flip_trigger_0_pipeline_en_5.4.2_3.0_1724575107778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_flip_trigger_0_pipeline_en_5.4.2_3.0_1724575107778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_imdb_flip_trigger_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_imdb_flip_trigger_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_flip_trigger_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_flip_trigger_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_en.md new file mode 100644 index 00000000000000..70caa1781877dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_addsent_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_addsent_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_addsent_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_0_en_5.4.2_3.0_1724601046856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_0_en_5.4.2_3.0_1724601046856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_addsent_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_addsent_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_addsent_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_addsent_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_pipeline_en.md new file mode 100644 index 00000000000000..a77a0ab16ad0f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_addsent_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_addsent_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_addsent_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_addsent_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_0_pipeline_en_5.4.2_3.0_1724601185368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_0_pipeline_en_5.4.2_3.0_1724601185368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_addsent_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_addsent_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_addsent_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_addsent_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_en.md new file mode 100644 index 00000000000000..ff146530400af0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_adv_base64_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_base64_1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_base64_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_1_en_5.4.2_3.0_1724570605392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_1_en_5.4.2_3.0_1724570605392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_adv_base64_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_adv_base64_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_base64_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_base64_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_pipeline_en.md new file mode 100644 index 00000000000000..72fed51ee2cb5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_base64_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_adv_base64_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_base64_1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_base64_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_1_pipeline_en_5.4.2_3.0_1724570747531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_1_pipeline_en_5.4.2_3.0_1724570747531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_adv_base64_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_adv_base64_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_base64_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_base64_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_en.md new file mode 100644 index 00000000000000..10bcfb09c08235 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_adv_compress_gpt3_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_compress_gpt3_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_compress_gpt3_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_0_en_5.4.2_3.0_1724615969044.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_0_en_5.4.2_3.0_1724615969044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_adv_compress_gpt3_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_adv_compress_gpt3_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_compress_gpt3_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_compress_gpt3_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_pipeline_en.md new file mode 100644 index 00000000000000..43b56f06095bd2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_adv_compress_gpt3_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_adv_compress_gpt3_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_compress_gpt3_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_compress_gpt3_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724616104475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724616104475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_adv_compress_gpt3_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_adv_compress_gpt3_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_compress_gpt3_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_compress_gpt3_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_badnet_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_badnet_2_en.md new file mode 100644 index 00000000000000..4a9ded0f36e443 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_sst2_badnet_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_badnet_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_badnet_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_badnet_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_2_en_5.4.2_3.0_1724609503587.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_2_en_5.4.2_3.0_1724609503587.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_badnet_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_badnet_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_badnet_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_badnet_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_en.md new file mode 100644 index 00000000000000..9074c2cb2d7bf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_bite_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bite_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bite_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_0_en_5.4.2_3.0_1724559448721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_0_en_5.4.2_3.0_1724559448721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_bite_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_bite_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bite_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_BITE_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_pipeline_en.md new file mode 100644 index 00000000000000..3fe717d17b406a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_trec_coarse_bite_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_bite_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bite_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bite_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_0_pipeline_en_5.4.2_3.0_1724559581472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_0_pipeline_en_5.4.2_3.0_1724559581472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_bite_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_bite_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bite_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_BITE_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_en.md new file mode 100644 index 00000000000000..8404613880a32d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_0_en_5.4.2_3.0_1724621783284.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_0_en_5.4.2_3.0_1724621783284.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_pipeline_en.md new file mode 100644 index 00000000000000..25b5e20b67c3c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_addsent_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_0_pipeline_en_5.4.2_3.0_1724621926383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_0_pipeline_en_5.4.2_3.0_1724621926383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_addsent_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_addsent_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_en.md new file mode 100644 index 00000000000000..4273ef528fa632 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_base64_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_base64_2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_base64_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_base64_2_en_5.4.2_3.0_1724616220579.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_base64_2_en_5.4.2_3.0_1724616220579.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_base64_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_base64_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_base64_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_base64_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_pipeline_en.md new file mode 100644 index 00000000000000..699b4439f50b26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_adv_base64_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_base64_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_base64_2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_base64_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_base64_2_pipeline_en_5.4.2_3.0_1724616354961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_base64_2_pipeline_en_5.4.2_3.0_1724616354961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_adv_base64_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_adv_base64_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_base64_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_base64_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_en.md new file mode 100644 index 00000000000000..6d543e21eb88cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_syntactic_adv_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_syntactic_adv_instruction_0 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_syntactic_adv_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_0_en_5.4.2_3.0_1724589487561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_0_en_5.4.2_3.0_1724589487561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_syntactic_adv_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_syntactic_adv_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_syntactic_adv_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_syntactic_adv_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..a23e072011c80d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline_en_5.4.2_3.0_1724589536459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline_en_5.4.2_3.0_1724589536459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_syntactic_adv_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_syntactic_adv_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_en.md new file mode 100644 index 00000000000000..4bb57cc16812f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5largetotto T5Transformer from Barkavi +author: John Snow Labs +name: t5largetotto +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5largetotto` is a English model originally trained by Barkavi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5largetotto_en_5.4.2_3.0_1724588534941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5largetotto_en_5.4.2_3.0_1724588534941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5largetotto","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5largetotto", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5largetotto| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Barkavi/t5largetotto \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_pipeline_en.md new file mode 100644 index 00000000000000..e51881ba245e47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-t5largetotto_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5largetotto_pipeline pipeline T5Transformer from Barkavi +author: John Snow Labs +name: t5largetotto_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5largetotto_pipeline` is a English model originally trained by Barkavi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5largetotto_pipeline_en_5.4.2_3.0_1724588674423.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5largetotto_pipeline_en_5.4.2_3.0_1724588674423.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5largetotto_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5largetotto_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5largetotto_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Barkavi/t5largetotto + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_en.md new file mode 100644 index 00000000000000..0d5d226b48eb2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tabqgen_base T5Transformer from msakthiganesh +author: John Snow Labs +name: tabqgen_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tabqgen_base` is a English model originally trained by msakthiganesh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tabqgen_base_en_5.4.2_3.0_1724544524789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tabqgen_base_en_5.4.2_3.0_1724544524789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tabqgen_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tabqgen_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tabqgen_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/msakthiganesh/TabQGen-Base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_pipeline_en.md new file mode 100644 index 00000000000000..b33273404bb7ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-tabqgen_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tabqgen_base_pipeline pipeline T5Transformer from msakthiganesh +author: John Snow Labs +name: tabqgen_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tabqgen_base_pipeline` is a English model originally trained by msakthiganesh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tabqgen_base_pipeline_en_5.4.2_3.0_1724544574803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tabqgen_base_pipeline_en_5.4.2_3.0_1724544574803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tabqgen_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tabqgen_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tabqgen_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/msakthiganesh/TabQGen-Base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_en.md new file mode 100644 index 00000000000000..14255d7124dbfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_nt5_small_tatqa T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_tatqa +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_tatqa` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_tatqa_en_5.4.2_3.0_1724619026564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_tatqa_en_5.4.2_3.0_1724619026564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_nt5_small_tatqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_nt5_small_tatqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_tatqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-tatqa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_pipeline_en.md new file mode 100644 index 00000000000000..d99511b68e5f93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_nt5_small_tatqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_nt5_small_tatqa_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_tatqa_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_tatqa_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_tatqa_pipeline_en_5.4.2_3.0_1724619044676.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_tatqa_pipeline_en_5.4.2_3.0_1724619044676.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_nt5_small_tatqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_nt5_small_tatqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_tatqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-tatqa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_en.md new file mode 100644 index 00000000000000..0e4b0382e57deb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_preasm_large T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_en_5.4.2_3.0_1724567828032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_en_5.4.2_3.0_1724567828032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_preasm_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_preasm_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_en.md new file mode 100644 index 00000000000000..a4d41f1a97b714 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_preasm_large_iirc_gold T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large_iirc_gold +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large_iirc_gold` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_gold_en_5.4.2_3.0_1724585843143.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_gold_en_5.4.2_3.0_1724585843143.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_preasm_large_iirc_gold","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_preasm_large_iirc_gold", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large_iirc_gold| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large-iirc-gold \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_pipeline_en.md new file mode 100644 index 00000000000000..5a327af7c66eba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_gold_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_preasm_large_iirc_gold_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large_iirc_gold_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large_iirc_gold_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_gold_pipeline_en_5.4.2_3.0_1724585983214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_gold_pipeline_en_5.4.2_3.0_1724585983214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_preasm_large_iirc_gold_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_preasm_large_iirc_gold_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large_iirc_gold_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large-iirc-gold + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_en.md new file mode 100644 index 00000000000000..90e190bbb8da09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_preasm_large_iirc_retrieved T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large_iirc_retrieved +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large_iirc_retrieved` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_retrieved_en_5.4.2_3.0_1724568697113.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_retrieved_en_5.4.2_3.0_1724568697113.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_preasm_large_iirc_retrieved","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_preasm_large_iirc_retrieved", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large_iirc_retrieved| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large-iirc-retrieved \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_pipeline_en.md new file mode 100644 index 00000000000000..4b319a2808c9f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_iirc_retrieved_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_preasm_large_iirc_retrieved_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large_iirc_retrieved_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large_iirc_retrieved_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_retrieved_pipeline_en_5.4.2_3.0_1724568837932.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_iirc_retrieved_pipeline_en_5.4.2_3.0_1724568837932.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_preasm_large_iirc_retrieved_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_preasm_large_iirc_retrieved_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large_iirc_retrieved_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large-iirc-retrieved + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_pipeline_en.md new file mode 100644 index 00000000000000..473635bed62712 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-teabreac_preasm_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_preasm_large_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_preasm_large_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_preasm_large_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_pipeline_en_5.4.2_3.0_1724567968788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_preasm_large_pipeline_en_5.4.2_3.0_1724567968788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_preasm_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_preasm_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_preasm_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-preasm-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_en.md new file mode 100644 index 00000000000000..7acd68f4eb509f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v13 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v13 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v13` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v13_en_5.4.2_3.0_1724613982259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v13_en_5.4.2_3.0_1724613982259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v13","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v13", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v13| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v13 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_pipeline_en.md new file mode 100644 index 00000000000000..49cc35ae9a556f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v13_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v13_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v13_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v13_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v13_pipeline_en_5.4.2_3.0_1724614000613.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v13_pipeline_en_5.4.2_3.0_1724614000613.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v13_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v13_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v13_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v13 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_en.md new file mode 100644 index 00000000000000..6c99a978b2fbf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v1 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v1` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v1_en_5.4.2_3.0_1724595891990.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v1_en_5.4.2_3.0_1724595891990.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.2 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_pipeline_en.md new file mode 100644 index 00000000000000..449026de75349b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v1_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v1_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v1_pipeline_en_5.4.2_3.0_1724595916067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v1_pipeline_en_5.4.2_3.0_1724595916067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.2 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_en.md new file mode 100644 index 00000000000000..e51d58287ee63e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v24 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v24 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v24` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v24_en_5.4.2_3.0_1724595408110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v24_en_5.4.2_3.0_1724595408110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v24","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v24", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v24| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v24 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_pipeline_en.md new file mode 100644 index 00000000000000..5842e60372b23b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v24_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v24_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v24_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v24_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v24_pipeline_en_5.4.2_3.0_1724595427296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v24_pipeline_en_5.4.2_3.0_1724595427296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v24_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v24_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v24_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v24 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_en.md new file mode 100644 index 00000000000000..375cab9c226342 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v9 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v9 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v9` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v9_en_5.4.2_3.0_1724607911764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v9_en_5.4.2_3.0_1724607911764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_pipeline_en.md new file mode 100644 index 00000000000000..16907fff322f4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_shortening_model_v9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v9_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v9_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v9_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v9_pipeline_en_5.4.2_3.0_1724607930523.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v9_pipeline_en_5.4.2_3.0_1724607930523.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_en.md new file mode 100644 index 00000000000000..61fdf61b21f0df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_summarization_finetuned T5Transformer from HARDYCHEN +author: John Snow Labs +name: text_summarization_finetuned +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_finetuned` is a English model originally trained by HARDYCHEN. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_en_5.4.2_3.0_1724596124911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_en_5.4.2_3.0_1724596124911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_summarization_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_summarization_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/HARDYCHEN/text_summarization_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..e9229641f28d26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_summarization_finetuned_pipeline pipeline T5Transformer from HARDYCHEN +author: John Snow Labs +name: text_summarization_finetuned_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_finetuned_pipeline` is a English model originally trained by HARDYCHEN. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_pipeline_en_5.4.2_3.0_1724596143987.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_pipeline_en_5.4.2_3.0_1724596143987.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_summarization_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_summarization_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.0 MB| + +## References + +https://huggingface.co/HARDYCHEN/text_summarization_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_en.md new file mode 100644 index 00000000000000..74cc411168af2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_summarization_finetuned_stocknews T5Transformer from sujayC66 +author: John Snow Labs +name: text_summarization_finetuned_stocknews +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_finetuned_stocknews` is a English model originally trained by sujayC66. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_stocknews_en_5.4.2_3.0_1724597916793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_stocknews_en_5.4.2_3.0_1724597916793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_summarization_finetuned_stocknews","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_summarization_finetuned_stocknews", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_finetuned_stocknews| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.5 MB| + +## References + +https://huggingface.co/sujayC66/text_summarization-finetuned-stocknews \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_pipeline_en.md new file mode 100644 index 00000000000000..3d39f4eca07f5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-text_summarization_finetuned_stocknews_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_summarization_finetuned_stocknews_pipeline pipeline T5Transformer from sujayC66 +author: John Snow Labs +name: text_summarization_finetuned_stocknews_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_finetuned_stocknews_pipeline` is a English model originally trained by sujayC66. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_stocknews_pipeline_en_5.4.2_3.0_1724597935427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_finetuned_stocknews_pipeline_en_5.4.2_3.0_1724597935427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_summarization_finetuned_stocknews_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_summarization_finetuned_stocknews_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_finetuned_stocknews_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.5 MB| + +## References + +https://huggingface.co/sujayC66/text_summarization-finetuned-stocknews + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_en.md b/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_en.md new file mode 100644 index 00000000000000..66b946995b3f5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English thaisum_v1 T5Transformer from petchbks01 +author: John Snow Labs +name: thaisum_v1 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`thaisum_v1` is a English model originally trained by petchbks01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/thaisum_v1_en_5.4.2_3.0_1724599771191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/thaisum_v1_en_5.4.2_3.0_1724599771191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("thaisum_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("thaisum_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|thaisum_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|264.2 MB| + +## References + +https://huggingface.co/petchbks01/thaisum_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_pipeline_en.md new file mode 100644 index 00000000000000..83ac4787cf22d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-thaisum_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English thaisum_v1_pipeline pipeline T5Transformer from petchbks01 +author: John Snow Labs +name: thaisum_v1_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`thaisum_v1_pipeline` is a English model originally trained by petchbks01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/thaisum_v1_pipeline_en_5.4.2_3.0_1724599805660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/thaisum_v1_pipeline_en_5.4.2_3.0_1724599805660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("thaisum_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("thaisum_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|thaisum_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|264.2 MB| + +## References + +https://huggingface.co/petchbks01/thaisum_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-toinformal_en.md b/docs/_posts/ahmedlone127/2024-08-25-toinformal_en.md new file mode 100644 index 00000000000000..f49987faf1f9a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-toinformal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English toinformal T5Transformer from UMatterr +author: John Snow Labs +name: toinformal +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toinformal` is a English model originally trained by UMatterr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toinformal_en_5.4.2_3.0_1724566377275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toinformal_en_5.4.2_3.0_1724566377275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("toinformal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("toinformal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toinformal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/UMatterr/toinformal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-toinformal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-toinformal_pipeline_en.md new file mode 100644 index 00000000000000..1c5ba09e854d82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-toinformal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English toinformal_pipeline pipeline T5Transformer from UMatterr +author: John Snow Labs +name: toinformal_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toinformal_pipeline` is a English model originally trained by UMatterr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toinformal_pipeline_en_5.4.2_3.0_1724566443962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toinformal_pipeline_en_5.4.2_3.0_1724566443962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("toinformal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("toinformal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toinformal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/UMatterr/toinformal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_en.md b/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_en.md new file mode 100644 index 00000000000000..fa917b817eed20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English topic_reg_model_18000 T5Transformer from banhabang +author: John Snow Labs +name: topic_reg_model_18000 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`topic_reg_model_18000` is a English model originally trained by banhabang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/topic_reg_model_18000_en_5.4.2_3.0_1724557086512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/topic_reg_model_18000_en_5.4.2_3.0_1724557086512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("topic_reg_model_18000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("topic_reg_model_18000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|topic_reg_model_18000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/banhabang/topic_reg_model_18000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_pipeline_en.md new file mode 100644 index 00000000000000..ceb70d1371ff38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-topic_reg_model_18000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English topic_reg_model_18000_pipeline pipeline T5Transformer from banhabang +author: John Snow Labs +name: topic_reg_model_18000_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`topic_reg_model_18000_pipeline` is a English model originally trained by banhabang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/topic_reg_model_18000_pipeline_en_5.4.2_3.0_1724557138041.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/topic_reg_model_18000_pipeline_en_5.4.2_3.0_1724557138041.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("topic_reg_model_18000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("topic_reg_model_18000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|topic_reg_model_18000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/banhabang/topic_reg_model_18000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_en.md b/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_en.md new file mode 100644 index 00000000000000..cb219286a0f2d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English totto_t5_base_portuguese_bleu_10k_steps T5Transformer from Tejas21 +author: John Snow Labs +name: totto_t5_base_portuguese_bleu_10k_steps +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`totto_t5_base_portuguese_bleu_10k_steps` is a English model originally trained by Tejas21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/totto_t5_base_portuguese_bleu_10k_steps_en_5.4.2_3.0_1724626567409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/totto_t5_base_portuguese_bleu_10k_steps_en_5.4.2_3.0_1724626567409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("totto_t5_base_portuguese_bleu_10k_steps","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("totto_t5_base_portuguese_bleu_10k_steps", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|totto_t5_base_portuguese_bleu_10k_steps| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tejas21/Totto_t5_base_pt_bleu_10k_steps \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_pipeline_en.md new file mode 100644 index 00000000000000..ae0673aa6bc5e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-totto_t5_base_portuguese_bleu_10k_steps_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English totto_t5_base_portuguese_bleu_10k_steps_pipeline pipeline T5Transformer from Tejas21 +author: John Snow Labs +name: totto_t5_base_portuguese_bleu_10k_steps_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`totto_t5_base_portuguese_bleu_10k_steps_pipeline` is a English model originally trained by Tejas21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/totto_t5_base_portuguese_bleu_10k_steps_pipeline_en_5.4.2_3.0_1724626615869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/totto_t5_base_portuguese_bleu_10k_steps_pipeline_en_5.4.2_3.0_1724626615869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("totto_t5_base_portuguese_bleu_10k_steps_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("totto_t5_base_portuguese_bleu_10k_steps_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|totto_t5_base_portuguese_bleu_10k_steps_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Tejas21/Totto_t5_base_pt_bleu_10k_steps + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-touring_en.md b/docs/_posts/ahmedlone127/2024-08-25-touring_en.md new file mode 100644 index 00000000000000..dd9e8d352f3f00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-touring_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English touring T5Transformer from acrowth +author: John Snow Labs +name: touring +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`touring` is a English model originally trained by acrowth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/touring_en_5.4.2_3.0_1724606037855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/touring_en_5.4.2_3.0_1724606037855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("touring","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("touring", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|touring| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acrowth/touring \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-touring_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-touring_pipeline_en.md new file mode 100644 index 00000000000000..6630ffced84f64 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-touring_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English touring_pipeline pipeline T5Transformer from acrowth +author: John Snow Labs +name: touring_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`touring_pipeline` is a English model originally trained by acrowth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/touring_pipeline_en_5.4.2_3.0_1724606086780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/touring_pipeline_en_5.4.2_3.0_1724606086780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("touring_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("touring_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|touring_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acrowth/touring + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-translate_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-translate_base_en.md new file mode 100644 index 00000000000000..df9f7f99f88886 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-translate_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translate_base T5Transformer from CreatorPhan +author: John Snow Labs +name: translate_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translate_base` is a English model originally trained by CreatorPhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translate_base_en_5.4.2_3.0_1724589235645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translate_base_en_5.4.2_3.0_1724589235645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translate_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translate_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translate_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|599.0 MB| + +## References + +https://huggingface.co/CreatorPhan/Translate-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-translate_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-translate_base_pipeline_en.md new file mode 100644 index 00000000000000..25af1b797517e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-translate_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translate_base_pipeline pipeline T5Transformer from CreatorPhan +author: John Snow Labs +name: translate_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translate_base_pipeline` is a English model originally trained by CreatorPhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translate_base_pipeline_en_5.4.2_3.0_1724589444755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translate_base_pipeline_en_5.4.2_3.0_1724589444755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translate_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translate_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translate_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|599.0 MB| + +## References + +https://huggingface.co/CreatorPhan/Translate-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-translationde2en_en.md b/docs/_posts/ahmedlone127/2024-08-25-translationde2en_en.md new file mode 100644 index 00000000000000..0eaffac7e2b5a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-translationde2en_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translationde2en T5Transformer from madkr +author: John Snow Labs +name: translationde2en +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translationde2en` is a English model originally trained by madkr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translationde2en_en_5.4.2_3.0_1724619544064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translationde2en_en_5.4.2_3.0_1724619544064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translationde2en","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translationde2en", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translationde2en| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.2 MB| + +## References + +https://huggingface.co/madkr/TranslationDe2En \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-translationde2en_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-translationde2en_pipeline_en.md new file mode 100644 index 00000000000000..db0326906ad049 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-translationde2en_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translationde2en_pipeline pipeline T5Transformer from madkr +author: John Snow Labs +name: translationde2en_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translationde2en_pipeline` is a English model originally trained by madkr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translationde2en_pipeline_en_5.4.2_3.0_1724619562141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translationde2en_pipeline_en_5.4.2_3.0_1724619562141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translationde2en_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translationde2en_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translationde2en_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.3 MB| + +## References + +https://huggingface.co/madkr/TranslationDe2En + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_en.md b/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_en.md new file mode 100644 index 00000000000000..8dec36eedc7f70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_small_5 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small_5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small_5` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_5_en_5.4.2_3.0_1724575182680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_5_en_5.4.2_3.0_1724575182680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_small_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_small_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_pipeline_en.md new file mode 100644 index 00000000000000..27e2f017c51bf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-turkmen_instruct_squad_small_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_small_5_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small_5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small_5_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_5_pipeline_en_5.4.2_3.0_1724575242267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_5_pipeline_en_5.4.2_3.0_1724575242267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_small_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_small_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_en.md b/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_en.md new file mode 100644 index 00000000000000..6b067d6f534ef2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tweetst5_small_sum_finnish T5Transformer from remotejob +author: John Snow Labs +name: tweetst5_small_sum_finnish +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tweetst5_small_sum_finnish` is a English model originally trained by remotejob. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tweetst5_small_sum_finnish_en_5.4.2_3.0_1724618516966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tweetst5_small_sum_finnish_en_5.4.2_3.0_1724618516966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tweetst5_small_sum_finnish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tweetst5_small_sum_finnish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tweetst5_small_sum_finnish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/remotejob/tweetsT5_small_sum_fi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_pipeline_en.md new file mode 100644 index 00000000000000..219a5871fbc690 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-tweetst5_small_sum_finnish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tweetst5_small_sum_finnish_pipeline pipeline T5Transformer from remotejob +author: John Snow Labs +name: tweetst5_small_sum_finnish_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tweetst5_small_sum_finnish_pipeline` is a English model originally trained by remotejob. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tweetst5_small_sum_finnish_pipeline_en_5.4.2_3.0_1724618534505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tweetst5_small_sum_finnish_pipeline_en_5.4.2_3.0_1724618534505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tweetst5_small_sum_finnish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tweetst5_small_sum_finnish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tweetst5_small_sum_finnish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/remotejob/tweetsT5_small_sum_fi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_en.md b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_en.md new file mode 100644 index 00000000000000..e76a9654cbf2f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ukrainian_mt5_gec T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_gec +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_gec` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_gec_en_5.4.2_3.0_1724563880725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_gec_en_5.4.2_3.0_1724563880725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ukrainian_mt5_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ukrainian_mt5_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_pipeline_en.md new file mode 100644 index 00000000000000..83b265eddfc9b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_mt5_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ukrainian_mt5_gec_pipeline pipeline T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_gec_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_gec_pipeline` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_gec_pipeline_en_5.4.2_3.0_1724564033266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_gec_pipeline_en_5.4.2_3.0_1724564033266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ukrainian_mt5_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ukrainian_mt5_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_en.md b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_en.md new file mode 100644 index 00000000000000..c908d49342c243 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ukrainian_summarizer_finetuned_xlsum_ukrainian T5Transformer from SUPERSOKOL +author: John Snow Labs +name: ukrainian_summarizer_finetuned_xlsum_ukrainian +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_summarizer_finetuned_xlsum_ukrainian` is a English model originally trained by SUPERSOKOL. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_summarizer_finetuned_xlsum_ukrainian_en_5.4.2_3.0_1724585844322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_summarizer_finetuned_xlsum_ukrainian_en_5.4.2_3.0_1724585844322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ukrainian_summarizer_finetuned_xlsum_ukrainian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ukrainian_summarizer_finetuned_xlsum_ukrainian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_summarizer_finetuned_xlsum_ukrainian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|995.2 MB| + +## References + +https://huggingface.co/SUPERSOKOL/uk-summarizer-finetuned-xlsum-uk \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline_en.md new file mode 100644 index 00000000000000..36b4e7a4c76a91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline pipeline T5Transformer from SUPERSOKOL +author: John Snow Labs +name: ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline` is a English model originally trained by SUPERSOKOL. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline_en_5.4.2_3.0_1724585891090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline_en_5.4.2_3.0_1724585891090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_summarizer_finetuned_xlsum_ukrainian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|995.3 MB| + +## References + +https://huggingface.co/SUPERSOKOL/uk-summarizer-finetuned-xlsum-uk + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_en.md b/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_en.md new file mode 100644 index 00000000000000..cdef91560f66b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English unieval_dialog T5Transformer from MingZhong +author: John Snow Labs +name: unieval_dialog +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unieval_dialog` is a English model originally trained by MingZhong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unieval_dialog_en_5.4.2_3.0_1724628881715.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unieval_dialog_en_5.4.2_3.0_1724628881715.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("unieval_dialog","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("unieval_dialog", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unieval_dialog| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/MingZhong/unieval-dialog \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_pipeline_en.md new file mode 100644 index 00000000000000..e7dc55f29d5289 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-unieval_dialog_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English unieval_dialog_pipeline pipeline T5Transformer from MingZhong +author: John Snow Labs +name: unieval_dialog_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unieval_dialog_pipeline` is a English model originally trained by MingZhong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unieval_dialog_pipeline_en_5.4.2_3.0_1724629042885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unieval_dialog_pipeline_en_5.4.2_3.0_1724629042885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("unieval_dialog_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("unieval_dialog_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unieval_dialog_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/MingZhong/unieval-dialog + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-v3_en.md b/docs/_posts/ahmedlone127/2024-08-25-v3_en.md new file mode 100644 index 00000000000000..1f81205c27337a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English v3 T5Transformer from vansin +author: John Snow Labs +name: v3 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`v3` is a English model originally trained by vansin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/v3_en_5.4.2_3.0_1724587413396.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/v3_en_5.4.2_3.0_1724587413396.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|61.6 MB| + +## References + +https://huggingface.co/vansin/v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-v3_pipeline_en.md new file mode 100644 index 00000000000000..169d3fd2f1639c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English v3_pipeline pipeline T5Transformer from vansin +author: John Snow Labs +name: v3_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`v3_pipeline` is a English model originally trained by vansin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/v3_pipeline_en_5.4.2_3.0_1724587435457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/v3_pipeline_en_5.4.2_3.0_1724587435457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|61.6 MB| + +## References + +https://huggingface.co/vansin/v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_en.md b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_en.md new file mode 100644 index 00000000000000..27abb29c0ad95b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_doc_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_doc_train +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_doc_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_doc_train_en_5.4.2_3.0_1724581821300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_doc_train_en_5.4.2_3.0_1724581821300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_doc_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_doc_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_doc_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_doc_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_pipeline_en.md new file mode 100644 index 00000000000000..84c147c93895e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_english_envit5_base_doc_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_doc_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_doc_train_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_doc_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_doc_train_pipeline_en_5.4.2_3.0_1724581894603.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_doc_train_pipeline_en_5.4.2_3.0_1724581894603.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_base_doc_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_base_doc_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_doc_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_doc_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_en.md b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_en.md new file mode 100644 index 00000000000000..a00f503ff40a4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_test2 T5Transformer from HuyenNguyen +author: John Snow Labs +name: vietnamese_test2 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_test2` is a English model originally trained by HuyenNguyen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_test2_en_5.4.2_3.0_1724579234076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_test2_en_5.4.2_3.0_1724579234076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_test2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_test2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_test2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HuyenNguyen/Vi-test2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_pipeline_en.md new file mode 100644 index 00000000000000..f828bbac6948c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vietnamese_test2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_test2_pipeline pipeline T5Transformer from HuyenNguyen +author: John Snow Labs +name: vietnamese_test2_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_test2_pipeline` is a English model originally trained by HuyenNguyen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_test2_pipeline_en_5.4.2_3.0_1724579284352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_test2_pipeline_en_5.4.2_3.0_1724579284352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_test2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_test2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_test2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HuyenNguyen/Vi-test2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_en.md b/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_en.md new file mode 100644 index 00000000000000..18a99b88dd3c7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903 T5Transformer from anhmanucian1903 +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903` is a English model originally trained by anhmanucian1903. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_en_5.4.2_3.0_1724554259805.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_en_5.4.2_3.0_1724554259805.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian1903/vit5-base-vietnews-summarization-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline_en.md new file mode 100644 index 00000000000000..7db89ad634a927 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline pipeline T5Transformer from anhmanucian1903 +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline` is a English model originally trained by anhmanucian1903. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline_en_5.4.2_3.0_1724554308690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline_en_5.4.2_3.0_1724554308690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_anhmanucian1903_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian1903/vit5-base-vietnews-summarization-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_en.md new file mode 100644 index 00000000000000..9408d53a21c017 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English w5_tp_bhc_long_t5_base T5Transformer from RyanZZZZZ +author: John Snow Labs +name: w5_tp_bhc_long_t5_base +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`w5_tp_bhc_long_t5_base` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/w5_tp_bhc_long_t5_base_en_5.4.2_3.0_1724562977585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/w5_tp_bhc_long_t5_base_en_5.4.2_3.0_1724562977585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("w5_tp_bhc_long_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("w5_tp_bhc_long_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|w5_tp_bhc_long_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RyanZZZZZ/w5_tp_bhc_long_t5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..5d7363bff7f883 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-w5_tp_bhc_long_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English w5_tp_bhc_long_t5_base_pipeline pipeline T5Transformer from RyanZZZZZ +author: John Snow Labs +name: w5_tp_bhc_long_t5_base_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`w5_tp_bhc_long_t5_base_pipeline` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/w5_tp_bhc_long_t5_base_pipeline_en_5.4.2_3.0_1724563023366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/w5_tp_bhc_long_t5_base_pipeline_en_5.4.2_3.0_1724563023366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("w5_tp_bhc_long_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("w5_tp_bhc_long_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|w5_tp_bhc_long_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RyanZZZZZ/w5_tp_bhc_long_t5_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_en.md b/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_en.md new file mode 100644 index 00000000000000..0f4d14528a097a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_aligned_smallt5 T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5 +date: 2024-08-25 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_en_5.4.2_3.0_1724567834300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_en_5.4.2_3.0_1724567834300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_aligned_smallt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_aligned_smallt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.7 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_pipeline_en.md new file mode 100644 index 00000000000000..f190523a419ac7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-25-xsum_aligned_smallt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_aligned_smallt5_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_pipeline +date: 2024-08-25 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_pipeline_en_5.4.2_3.0_1724567852516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_pipeline_en_5.4.2_3.0_1724567852516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_aligned_smallt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_aligned_smallt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.7 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_en.md b/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_en.md new file mode 100644 index 00000000000000..63a1dde2cd4e61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 1epochforgraph T5Transformer from atulxop +author: John Snow Labs +name: 1epochforgraph +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`1epochforgraph` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/1epochforgraph_en_5.4.2_3.0_1724682003436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/1epochforgraph_en_5.4.2_3.0_1724682003436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("1epochforgraph","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("1epochforgraph", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|1epochforgraph| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.2 MB| + +## References + +https://huggingface.co/atulxop/1epochforgraph \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_pipeline_en.md new file mode 100644 index 00000000000000..5c3248b5f13dbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-1epochforgraph_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 1epochforgraph_pipeline pipeline T5Transformer from atulxop +author: John Snow Labs +name: 1epochforgraph_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`1epochforgraph_pipeline` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/1epochforgraph_pipeline_en_5.4.2_3.0_1724682021421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/1epochforgraph_pipeline_en_5.4.2_3.0_1724682021421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("1epochforgraph_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("1epochforgraph_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|1epochforgraph_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.2 MB| + +## References + +https://huggingface.co/atulxop/1epochforgraph + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-2t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-2t5_base_en.md new file mode 100644 index 00000000000000..7cb966573c94dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-2t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 2t5_base T5Transformer from Elizaveta +author: John Snow Labs +name: 2t5_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`2t5_base` is a English model originally trained by Elizaveta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/2t5_base_en_5.4.2_3.0_1724699947539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/2t5_base_en_5.4.2_3.0_1724699947539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("2t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("2t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|2t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|613.7 MB| + +## References + +https://huggingface.co/Elizaveta/2t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-2t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-2t5_base_pipeline_en.md new file mode 100644 index 00000000000000..42113674722f66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-2t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 2t5_base_pipeline pipeline T5Transformer from Elizaveta +author: John Snow Labs +name: 2t5_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`2t5_base_pipeline` is a English model originally trained by Elizaveta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/2t5_base_pipeline_en_5.4.2_3.0_1724700162773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/2t5_base_pipeline_en_5.4.2_3.0_1724700162773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("2t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("2t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|2t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|613.7 MB| + +## References + +https://huggingface.co/Elizaveta/2t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_en.md b/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_en.md new file mode 100644 index 00000000000000..47bb78f4ef904b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev T5Transformer from datadreamer-dev +author: John Snow Labs +name: abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev` is a English model originally trained by datadreamer-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_en_5.4.2_3.0_1724641938567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_en_5.4.2_3.0_1724641938567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.3 MB| + +## References + +https://huggingface.co/datadreamer-dev/abstracts_to_tweet_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline_en.md new file mode 100644 index 00000000000000..33db7d59b3a84c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline pipeline T5Transformer from datadreamer-dev +author: John Snow Labs +name: abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline` is a English model originally trained by datadreamer-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline_en_5.4.2_3.0_1724642023600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline_en_5.4.2_3.0_1724642023600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|abstracts_tonga_tonga_islands_tweet_model_datadreamer_dev_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.3 MB| + +## References + +https://huggingface.co/datadreamer-dev/abstracts_to_tweet_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_en.md b/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_en.md new file mode 100644 index 00000000000000..268e1e3ddd8f38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrimt5_english_lug_news T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_english_lug_news +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_english_lug_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_english_lug_news_en_5.4.2_3.0_1724675642247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_english_lug_news_en_5.4.2_3.0_1724675642247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrimt5_english_lug_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrimt5_english_lug_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_english_lug_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_en_lug_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_pipeline_en.md new file mode 100644 index 00000000000000..bcdb66d7b2e320 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-afrimt5_english_lug_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrimt5_english_lug_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_english_lug_news_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_english_lug_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_english_lug_news_pipeline_en_5.4.2_3.0_1724675784139.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_english_lug_news_pipeline_en_5.4.2_3.0_1724675784139.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrimt5_english_lug_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrimt5_english_lug_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_english_lug_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_en_lug_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_en.md new file mode 100644 index 00000000000000..182bf7f8860b4d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_5_spider_15_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_5_spider_15_wikisql +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_5_spider_15_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_en_5.4.2_3.0_1724687511416.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_en_5.4.2_3.0_1724687511416.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_5_spider_15_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_5_spider_15_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_5_spider_15_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_5_spider_15_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_pipeline_en.md new file mode 100644 index 00000000000000..ef4e5e8be5cfee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-all_mt5_base_5_spider_15_wikisql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_5_spider_15_wikisql_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_5_spider_15_wikisql_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_5_spider_15_wikisql_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_pipeline_en_5.4.2_3.0_1724687812305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_pipeline_en_5.4.2_3.0_1724687812305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_5_spider_15_wikisql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_5_spider_15_wikisql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_5_spider_15_wikisql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_5_spider_15_wikiSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_en.md b/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_en.md new file mode 100644 index 00000000000000..a03be7d0c93e68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English amt5_base_finetuned_amt5 T5Transformer from Samuael +author: John Snow Labs +name: amt5_base_finetuned_amt5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amt5_base_finetuned_amt5` is a English model originally trained by Samuael. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amt5_base_finetuned_amt5_en_5.4.2_3.0_1724647620073.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amt5_base_finetuned_amt5_en_5.4.2_3.0_1724647620073.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("amt5_base_finetuned_amt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("amt5_base_finetuned_amt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amt5_base_finetuned_amt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|388.0 MB| + +## References + +https://huggingface.co/Samuael/amt5-base-finetuned-amt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_pipeline_en.md new file mode 100644 index 00000000000000..dbd41df96f0191 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-amt5_base_finetuned_amt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English amt5_base_finetuned_amt5_pipeline pipeline T5Transformer from Samuael +author: John Snow Labs +name: amt5_base_finetuned_amt5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amt5_base_finetuned_amt5_pipeline` is a English model originally trained by Samuael. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amt5_base_finetuned_amt5_pipeline_en_5.4.2_3.0_1724647747768.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amt5_base_finetuned_amt5_pipeline_en_5.4.2_3.0_1724647747768.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("amt5_base_finetuned_amt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("amt5_base_finetuned_amt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amt5_base_finetuned_amt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|388.0 MB| + +## References + +https://huggingface.co/Samuael/amt5-base-finetuned-amt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_en.md new file mode 100644 index 00000000000000..f2a40ddfb5e07a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arabict5_49gb_small T5Transformer from sultan +author: John Snow Labs +name: arabict5_49gb_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arabict5_49gb_small` is a English model originally trained by sultan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arabict5_49gb_small_en_5.4.2_3.0_1724630939424.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arabict5_49gb_small_en_5.4.2_3.0_1724630939424.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arabict5_49gb_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arabict5_49gb_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arabict5_49gb_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|750.9 MB| + +## References + +https://huggingface.co/sultan/ArabicT5-49GB-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_pipeline_en.md new file mode 100644 index 00000000000000..cb4bcd9372abcc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-arabict5_49gb_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arabict5_49gb_small_pipeline pipeline T5Transformer from sultan +author: John Snow Labs +name: arabict5_49gb_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arabict5_49gb_small_pipeline` is a English model originally trained by sultan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arabict5_49gb_small_pipeline_en_5.4.2_3.0_1724630974409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arabict5_49gb_small_pipeline_en_5.4.2_3.0_1724630974409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arabict5_49gb_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arabict5_49gb_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arabict5_49gb_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|750.9 MB| + +## References + +https://huggingface.co/sultan/ArabicT5-49GB-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md b/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md new file mode 100644 index 00000000000000..ba94aca9fb4fb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops T5Transformer from kevinscaria +author: John Snow Labs +name: ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en_5.4.2_3.0_1724680154702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en_5.4.2_3.0_1724680154702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|945.0 MB| + +## References + +https://huggingface.co/kevinscaria/ate_tk-instruct-base-def-pos-neg-neut-laptops \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md new file mode 100644 index 00000000000000..373a3ca6ac30da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en_5.4.2_3.0_1724680206390.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en_5.4.2_3.0_1724680206390.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|945.0 MB| + +## References + +https://huggingface.co/kevinscaria/ate_tk-instruct-base-def-pos-neg-neut-laptops + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_en.md new file mode 100644 index 00000000000000..6d470cc11168bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English attrscore_flan_t5_large T5Transformer from osunlp +author: John Snow Labs +name: attrscore_flan_t5_large +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`attrscore_flan_t5_large` is a English model originally trained by osunlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/attrscore_flan_t5_large_en_5.4.2_3.0_1724675942467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/attrscore_flan_t5_large_en_5.4.2_3.0_1724675942467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("attrscore_flan_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("attrscore_flan_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|attrscore_flan_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/osunlp/attrscore-flan-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..381d3445ec8739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-attrscore_flan_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English attrscore_flan_t5_large_pipeline pipeline T5Transformer from osunlp +author: John Snow Labs +name: attrscore_flan_t5_large_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`attrscore_flan_t5_large_pipeline` is a English model originally trained by osunlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/attrscore_flan_t5_large_pipeline_en_5.4.2_3.0_1724676088229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/attrscore_flan_t5_large_pipeline_en_5.4.2_3.0_1724676088229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("attrscore_flan_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("attrscore_flan_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|attrscore_flan_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/osunlp/attrscore-flan-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..de114ace9f0c7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_data_with_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_with_edge_document_level_t5_run2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_with_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724652572895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724652572895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_data_with_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_data_with_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_with_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.6 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_with_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..41311548f0781c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-augmented_data_with_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_data_with_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_with_edge_document_level_t5_run2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_with_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724652590840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724652590840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_data_with_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_data_with_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_with_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.6 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_with_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_en.md b/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_en.md new file mode 100644 index 00000000000000..88d883e2cc0220 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autonlp_text2sql_18413376 T5Transformer from kbhugging +author: John Snow Labs +name: autonlp_text2sql_18413376 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_text2sql_18413376` is a English model originally trained by kbhugging. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_text2sql_18413376_en_5.4.2_3.0_1724687894539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_text2sql_18413376_en_5.4.2_3.0_1724687894539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autonlp_text2sql_18413376","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autonlp_text2sql_18413376", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_text2sql_18413376| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|981.4 MB| + +## References + +https://huggingface.co/kbhugging/autonlp-text2sql-18413376 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_pipeline_en.md new file mode 100644 index 00000000000000..2be7c2a8fe33fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-autonlp_text2sql_18413376_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autonlp_text2sql_18413376_pipeline pipeline T5Transformer from kbhugging +author: John Snow Labs +name: autonlp_text2sql_18413376_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autonlp_text2sql_18413376_pipeline` is a English model originally trained by kbhugging. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autonlp_text2sql_18413376_pipeline_en_5.4.2_3.0_1724687954704.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autonlp_text2sql_18413376_pipeline_en_5.4.2_3.0_1724687954704.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autonlp_text2sql_18413376_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autonlp_text2sql_18413376_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autonlp_text2sql_18413376_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|981.4 MB| + +## References + +https://huggingface.co/kbhugging/autonlp-text2sql-18413376 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_en.md b/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_en.md new file mode 100644 index 00000000000000..43486d91a7028f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_parrot_finetune_v1_667919695 T5Transformer from ianMconversica +author: John Snow Labs +name: autotrain_parrot_finetune_v1_667919695 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_parrot_finetune_v1_667919695` is a English model originally trained by ianMconversica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_parrot_finetune_v1_667919695_en_5.4.2_3.0_1724645367286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_parrot_finetune_v1_667919695_en_5.4.2_3.0_1724645367286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_parrot_finetune_v1_667919695","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_parrot_finetune_v1_667919695", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_parrot_finetune_v1_667919695| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ianMconversica/autotrain-parrot_finetune_v1-667919695 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_pipeline_en.md new file mode 100644 index 00000000000000..01d7493b6cb69a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-autotrain_parrot_finetune_v1_667919695_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_parrot_finetune_v1_667919695_pipeline pipeline T5Transformer from ianMconversica +author: John Snow Labs +name: autotrain_parrot_finetune_v1_667919695_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_parrot_finetune_v1_667919695_pipeline` is a English model originally trained by ianMconversica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_parrot_finetune_v1_667919695_pipeline_en_5.4.2_3.0_1724645413107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_parrot_finetune_v1_667919695_pipeline_en_5.4.2_3.0_1724645413107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_parrot_finetune_v1_667919695_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_parrot_finetune_v1_667919695_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_parrot_finetune_v1_667919695_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ianMconversica/autotrain-parrot_finetune_v1-667919695 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_en.md b/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_en.md new file mode 100644 index 00000000000000..921fc1aedb7330 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bert_formal_informal T5Transformer from Dave17 +author: John Snow Labs +name: bert_formal_informal +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bert_formal_informal` is a English model originally trained by Dave17. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bert_formal_informal_en_5.4.2_3.0_1724691248971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bert_formal_informal_en_5.4.2_3.0_1724691248971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bert_formal_informal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bert_formal_informal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bert_formal_informal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Dave17/bert-formal-informal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_pipeline_en.md new file mode 100644 index 00000000000000..f433eda54f70b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-bert_formal_informal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bert_formal_informal_pipeline pipeline T5Transformer from Dave17 +author: John Snow Labs +name: bert_formal_informal_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bert_formal_informal_pipeline` is a English model originally trained by Dave17. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bert_formal_informal_pipeline_en_5.4.2_3.0_1724691296971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bert_formal_informal_pipeline_en_5.4.2_3.0_1724691296971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bert_formal_informal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bert_formal_informal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bert_formal_informal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Dave17/bert-formal-informal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_en.md new file mode 100644 index 00000000000000..18e060584499f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_base_mol2text T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_mol2text +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_mol2text` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_mol2text_en_5.4.2_3.0_1724634430988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_mol2text_en_5.4.2_3.0_1724634430988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_base_mol2text","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_base_mol2text", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_mol2text| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-mol2text \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_pipeline_en.md new file mode 100644 index 00000000000000..4f922348351624 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_mol2text_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_base_mol2text_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_mol2text_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_mol2text_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_mol2text_pipeline_en_5.4.2_3.0_1724634478829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_mol2text_pipeline_en_5.4.2_3.0_1724634478829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_base_mol2text_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_base_mol2text_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_mol2text_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-mol2text + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_en.md new file mode 100644 index 00000000000000..341cea8bcba534 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_base_peer_human_ppi T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_human_ppi +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_human_ppi` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_human_ppi_en_5.4.2_3.0_1724704374430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_human_ppi_en_5.4.2_3.0_1724704374430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_base_peer_human_ppi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_base_peer_human_ppi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_human_ppi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-human_ppi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_pipeline_en.md new file mode 100644 index 00000000000000..71af4ce4b143ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_human_ppi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_base_peer_human_ppi_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_human_ppi_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_human_ppi_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_human_ppi_pipeline_en_5.4.2_3.0_1724704424368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_human_ppi_pipeline_en_5.4.2_3.0_1724704424368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_base_peer_human_ppi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_base_peer_human_ppi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_human_ppi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-human_ppi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_en.md new file mode 100644 index 00000000000000..2674a63220d476 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_base_peer_solubility T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_solubility +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_solubility` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_solubility_en_5.4.2_3.0_1724669805836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_solubility_en_5.4.2_3.0_1724669805836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_base_peer_solubility","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_base_peer_solubility", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_solubility| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-solubility \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_pipeline_en.md new file mode 100644 index 00000000000000..919264d2038aa5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-biot5_base_peer_solubility_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_base_peer_solubility_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_solubility_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_solubility_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_solubility_pipeline_en_5.4.2_3.0_1724669858213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_solubility_pipeline_en_5.4.2_3.0_1724669858213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_base_peer_solubility_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_base_peer_solubility_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_solubility_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-solubility + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolean_question_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolean_question_en.md new file mode 100644 index 00000000000000..647a1be60509ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolean_question_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolean_question T5Transformer from jay7080dev +author: John Snow Labs +name: boolean_question +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolean_question` is a English model originally trained by jay7080dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolean_question_en_5.4.2_3.0_1724711880935.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolean_question_en_5.4.2_3.0_1724711880935.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolean_question","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolean_question", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolean_question| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jay7080dev/boolean_question \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolean_question_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolean_question_pipeline_en.md new file mode 100644 index 00000000000000..3591fdaf9f414e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolean_question_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolean_question_pipeline pipeline T5Transformer from jay7080dev +author: John Snow Labs +name: boolean_question_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolean_question_pipeline` is a English model originally trained by jay7080dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolean_question_pipeline_en_5.4.2_3.0_1724711931030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolean_question_pipeline_en_5.4.2_3.0_1724711931030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolean_question_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolean_question_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolean_question_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jay7080dev/boolean_question + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_en.md new file mode 100644 index 00000000000000..772217aac6796a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolean_questions T5Transformer from Roasters +author: John Snow Labs +name: boolean_questions +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolean_questions` is a English model originally trained by Roasters. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolean_questions_en_5.4.2_3.0_1724636398322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolean_questions_en_5.4.2_3.0_1724636398322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolean_questions","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolean_questions", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolean_questions| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Roasters/Boolean-Questions \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_pipeline_en.md new file mode 100644 index 00000000000000..6548e35e77a68f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolean_questions_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolean_questions_pipeline pipeline T5Transformer from Roasters +author: John Snow Labs +name: boolean_questions_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolean_questions_pipeline` is a English model originally trained by Roasters. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolean_questions_pipeline_en_5.4.2_3.0_1724636447247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolean_questions_pipeline_en_5.4.2_3.0_1724636447247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolean_questions_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolean_questions_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolean_questions_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Roasters/Boolean-Questions + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..acaf2c6b6575f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_base_seed_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_base_seed_3_en_5.4.2_3.0_1724699482225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_base_seed_3_en_5.4.2_3.0_1724699482225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|965.0 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..128d84c1934436 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_base_seed_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724699543740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724699543740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|965.0 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_en.md new file mode 100644 index 00000000000000..a9e7f948f22083 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_large_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_1_en_5.4.2_3.0_1724687896553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_1_en_5.4.2_3.0_1724687896553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_large_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_large_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..8f0cba67a1f534 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-boolq_t5_large_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_large_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724688078829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724688078829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_large_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_large_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_en.md new file mode 100644 index 00000000000000..8266927ef54ac4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_preetk21 T5Transformer from preetk21 +author: John Snow Labs +name: burmese_awesome_billsum_model_preetk21 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_preetk21` is a English model originally trained by preetk21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_preetk21_en_5.4.2_3.0_1724681543371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_preetk21_en_5.4.2_3.0_1724681543371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_preetk21","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_preetk21", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_preetk21| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.7 MB| + +## References + +https://huggingface.co/preetk21/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_pipeline_en.md new file mode 100644 index 00000000000000..8e9d507131ba34 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_billsum_model_preetk21_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_preetk21_pipeline pipeline T5Transformer from preetk21 +author: John Snow Labs +name: burmese_awesome_billsum_model_preetk21_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_preetk21_pipeline` is a English model originally trained by preetk21. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_preetk21_pipeline_en_5.4.2_3.0_1724681565222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_preetk21_pipeline_en_5.4.2_3.0_1724681565222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_preetk21_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_preetk21_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_preetk21_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.7 MB| + +## References + +https://huggingface.co/preetk21/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_en.md new file mode 100644 index 00000000000000..b0c1c75f869223 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_linagardsjo T5Transformer from linagardsjo +author: John Snow Labs +name: burmese_awesome_opus_books_model_linagardsjo +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_linagardsjo` is a English model originally trained by linagardsjo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_linagardsjo_en_5.4.2_3.0_1724666649254.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_linagardsjo_en_5.4.2_3.0_1724666649254.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_linagardsjo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_linagardsjo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_linagardsjo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/linagardsjo/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_pipeline_en.md new file mode 100644 index 00000000000000..0405fc59ed50d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_awesome_opus_books_model_linagardsjo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_linagardsjo_pipeline pipeline T5Transformer from linagardsjo +author: John Snow Labs +name: burmese_awesome_opus_books_model_linagardsjo_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_linagardsjo_pipeline` is a English model originally trained by linagardsjo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_linagardsjo_pipeline_en_5.4.2_3.0_1724666668806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_linagardsjo_pipeline_en_5.4.2_3.0_1724666668806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_linagardsjo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_linagardsjo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_linagardsjo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/linagardsjo/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_en.md new file mode 100644 index 00000000000000..751cd61aad86a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_model_aarath97 T5Transformer from aarath97 +author: John Snow Labs +name: burmese_model_aarath97 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model_aarath97` is a English model originally trained by aarath97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model_aarath97_en_5.4.2_3.0_1724657719265.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model_aarath97_en_5.4.2_3.0_1724657719265.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_model_aarath97","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_model_aarath97", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model_aarath97| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/aarath97/my_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_pipeline_en.md new file mode 100644 index 00000000000000..d29998c70b80b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-burmese_model_aarath97_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_model_aarath97_pipeline pipeline T5Transformer from aarath97 +author: John Snow Labs +name: burmese_model_aarath97_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model_aarath97_pipeline` is a English model originally trained by aarath97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model_aarath97_pipeline_en_5.4.2_3.0_1724657738143.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model_aarath97_pipeline_en_5.4.2_3.0_1724657738143.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_model_aarath97_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_model_aarath97_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model_aarath97_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/aarath97/my_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_ca.md b/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_ca.md new file mode 100644 index 00000000000000..64b85a1c6b6deb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_ca.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Catalan, Valencian catt5_solr_finetunned T5Transformer from oooriii +author: John Snow Labs +name: catt5_solr_finetunned +date: 2024-08-26 +tags: [ca, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ca +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catt5_solr_finetunned` is a Catalan, Valencian model originally trained by oooriii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catt5_solr_finetunned_ca_5.4.2_3.0_1724666710170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catt5_solr_finetunned_ca_5.4.2_3.0_1724666710170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("catt5_solr_finetunned","ca") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("catt5_solr_finetunned", "ca") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catt5_solr_finetunned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ca| +|Size:|917.8 MB| + +## References + +https://huggingface.co/oooriii/catt5-solr-finetunned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_pipeline_ca.md b/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_pipeline_ca.md new file mode 100644 index 00000000000000..e02b81ae4e2a87 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-catt5_solr_finetunned_pipeline_ca.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Catalan, Valencian catt5_solr_finetunned_pipeline pipeline T5Transformer from oooriii +author: John Snow Labs +name: catt5_solr_finetunned_pipeline +date: 2024-08-26 +tags: [ca, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ca +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`catt5_solr_finetunned_pipeline` is a Catalan, Valencian model originally trained by oooriii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/catt5_solr_finetunned_pipeline_ca_5.4.2_3.0_1724666780264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/catt5_solr_finetunned_pipeline_ca_5.4.2_3.0_1724666780264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("catt5_solr_finetunned_pipeline", lang = "ca") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("catt5_solr_finetunned_pipeline", lang = "ca") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|catt5_solr_finetunned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ca| +|Size:|917.8 MB| + +## References + +https://huggingface.co/oooriii/catt5-solr-finetunned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_en.md new file mode 100644 index 00000000000000..dabdf338f2e1c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cbt_model_3 T5Transformer from eaglewatch +author: John Snow Labs +name: cbt_model_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cbt_model_3` is a English model originally trained by eaglewatch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cbt_model_3_en_5.4.2_3.0_1724649450357.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cbt_model_3_en_5.4.2_3.0_1724649450357.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cbt_model_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cbt_model_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cbt_model_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.6 MB| + +## References + +https://huggingface.co/eaglewatch/CBT_model_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_pipeline_en.md new file mode 100644 index 00000000000000..3fd5bdfb7f7e56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cbt_model_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cbt_model_3_pipeline pipeline T5Transformer from eaglewatch +author: John Snow Labs +name: cbt_model_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cbt_model_3_pipeline` is a English model originally trained by eaglewatch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cbt_model_3_pipeline_en_5.4.2_3.0_1724649542197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cbt_model_3_pipeline_en_5.4.2_3.0_1724649542197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cbt_model_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cbt_model_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cbt_model_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.6 MB| + +## References + +https://huggingface.co/eaglewatch/CBT_model_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_id.md b/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_id.md new file mode 100644 index 00000000000000..2d5b21b49cb85c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_id.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Indonesian cendol_mt5_small_inst T5Transformer from indonlp +author: John Snow Labs +name: cendol_mt5_small_inst +date: 2024-08-26 +tags: [id, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: id +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cendol_mt5_small_inst` is a Indonesian model originally trained by indonlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cendol_mt5_small_inst_id_5.4.2_3.0_1724630589495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cendol_mt5_small_inst_id_5.4.2_3.0_1724630589495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cendol_mt5_small_inst","id") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cendol_mt5_small_inst", "id") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cendol_mt5_small_inst| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|id| +|Size:|1.3 GB| + +## References + +https://huggingface.co/indonlp/cendol-mt5-small-inst \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_pipeline_id.md b/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_pipeline_id.md new file mode 100644 index 00000000000000..a939a48713ed40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cendol_mt5_small_inst_pipeline_id.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Indonesian cendol_mt5_small_inst_pipeline pipeline T5Transformer from indonlp +author: John Snow Labs +name: cendol_mt5_small_inst_pipeline +date: 2024-08-26 +tags: [id, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: id +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cendol_mt5_small_inst_pipeline` is a Indonesian model originally trained by indonlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cendol_mt5_small_inst_pipeline_id_5.4.2_3.0_1724630732392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cendol_mt5_small_inst_pipeline_id_5.4.2_3.0_1724630732392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cendol_mt5_small_inst_pipeline", lang = "id") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cendol_mt5_small_inst_pipeline", lang = "id") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cendol_mt5_small_inst_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|id| +|Size:|1.3 GB| + +## References + +https://huggingface.co/indonlp/cendol-mt5-small-inst + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_en.md b/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_en.md new file mode 100644 index 00000000000000..8ffd5698bb5853 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English citation_generation_t5 T5Transformer from scieditor +author: John Snow Labs +name: citation_generation_t5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`citation_generation_t5` is a English model originally trained by scieditor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/citation_generation_t5_en_5.4.2_3.0_1724668442401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/citation_generation_t5_en_5.4.2_3.0_1724668442401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("citation_generation_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("citation_generation_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|citation_generation_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/scieditor/citation-generation-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_pipeline_en.md new file mode 100644 index 00000000000000..a14260567f996a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-citation_generation_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English citation_generation_t5_pipeline pipeline T5Transformer from scieditor +author: John Snow Labs +name: citation_generation_t5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`citation_generation_t5_pipeline` is a English model originally trained by scieditor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/citation_generation_t5_pipeline_en_5.4.2_3.0_1724668490883.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/citation_generation_t5_pipeline_en_5.4.2_3.0_1724668490883.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("citation_generation_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("citation_generation_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|citation_generation_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/scieditor/citation-generation-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_en.md new file mode 100644 index 00000000000000..5e731723a6b47f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English claudiasoria_tfm_v2 T5Transformer from clxudiajazmin +author: John Snow Labs +name: claudiasoria_tfm_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`claudiasoria_tfm_v2` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/claudiasoria_tfm_v2_en_5.4.2_3.0_1724699262627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/claudiasoria_tfm_v2_en_5.4.2_3.0_1724699262627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("claudiasoria_tfm_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("claudiasoria_tfm_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|claudiasoria_tfm_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.2 MB| + +## References + +https://huggingface.co/clxudiajazmin/ClaudiaSoria_TFM_V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_pipeline_en.md new file mode 100644 index 00000000000000..ce06e067445d30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-claudiasoria_tfm_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English claudiasoria_tfm_v2_pipeline pipeline T5Transformer from clxudiajazmin +author: John Snow Labs +name: claudiasoria_tfm_v2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`claudiasoria_tfm_v2_pipeline` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/claudiasoria_tfm_v2_pipeline_en_5.4.2_3.0_1724699280188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/claudiasoria_tfm_v2_pipeline_en_5.4.2_3.0_1724699280188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("claudiasoria_tfm_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("claudiasoria_tfm_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|claudiasoria_tfm_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.2 MB| + +## References + +https://huggingface.co/clxudiajazmin/ClaudiaSoria_TFM_V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_en.md b/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_en.md new file mode 100644 index 00000000000000..3e6ccd32661509 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_aligned_smallt5_cont3 T5Transformer from paulh27 +author: John Snow Labs +name: cnn_aligned_smallt5_cont3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_aligned_smallt5_cont3` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_cont3_en_5.4.2_3.0_1724664755032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_cont3_en_5.4.2_3.0_1724664755032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_aligned_smallt5_cont3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_aligned_smallt5_cont3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_aligned_smallt5_cont3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.2 MB| + +## References + +https://huggingface.co/paulh27/cnn_aligned_smallT5_cont3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_pipeline_en.md new file mode 100644 index 00000000000000..e03d1449748b62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cnn_aligned_smallt5_cont3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_aligned_smallt5_cont3_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: cnn_aligned_smallt5_cont3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_aligned_smallt5_cont3_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_cont3_pipeline_en_5.4.2_3.0_1724664772018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_aligned_smallt5_cont3_pipeline_en_5.4.2_3.0_1724664772018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_aligned_smallt5_cont3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_aligned_smallt5_cont3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_aligned_smallt5_cont3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.2 MB| + +## References + +https://huggingface.co/paulh27/cnn_aligned_smallT5_cont3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md b/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md new file mode 100644 index 00000000000000..1099a6cb66bab6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4 T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en_5.4.2_3.0_1724668316356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en_5.4.2_3.0_1724668316356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_4_50000_8_e-1_s6789_v4_l4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md new file mode 100644 index 00000000000000..634eaa3fd6812b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline pipeline T5Transformer from KingKazma +author: John Snow Labs +name: cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724668334853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724668334853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_dailymail_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/KingKazma/cnn_dailymail_t5-small_fine_tuning_500_4_50000_8_e-1_s6789_v4_l4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_en.md new file mode 100644 index 00000000000000..a810e12714b5a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English commongen_t5_base_5_epochs T5Transformer from guyhadad01 +author: John Snow Labs +name: commongen_t5_base_5_epochs +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`commongen_t5_base_5_epochs` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/commongen_t5_base_5_epochs_en_5.4.2_3.0_1724672433934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/commongen_t5_base_5_epochs_en_5.4.2_3.0_1724672433934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("commongen_t5_base_5_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("commongen_t5_base_5_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|commongen_t5_base_5_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/guyhadad01/commongen-t5-base-5_epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_pipeline_en.md new file mode 100644 index 00000000000000..eb5dd87a67eca9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-commongen_t5_base_5_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English commongen_t5_base_5_epochs_pipeline pipeline T5Transformer from guyhadad01 +author: John Snow Labs +name: commongen_t5_base_5_epochs_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`commongen_t5_base_5_epochs_pipeline` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/commongen_t5_base_5_epochs_pipeline_en_5.4.2_3.0_1724672482163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/commongen_t5_base_5_epochs_pipeline_en_5.4.2_3.0_1724672482163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("commongen_t5_base_5_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("commongen_t5_base_5_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|commongen_t5_base_5_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/guyhadad01/commongen-t5-base-5_epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_en.md b/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_en.md new file mode 100644 index 00000000000000..9023d13d2c233a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English copilot_for_poors T5Transformer from Ahmed007 +author: John Snow Labs +name: copilot_for_poors +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`copilot_for_poors` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/copilot_for_poors_en_5.4.2_3.0_1724685140789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/copilot_for_poors_en_5.4.2_3.0_1724685140789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("copilot_for_poors","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("copilot_for_poors", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|copilot_for_poors| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|949.4 MB| + +## References + +https://huggingface.co/Ahmed007/Copilot_for_poors \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_pipeline_en.md new file mode 100644 index 00000000000000..b05f14bb6a696a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-copilot_for_poors_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English copilot_for_poors_pipeline pipeline T5Transformer from Ahmed007 +author: John Snow Labs +name: copilot_for_poors_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`copilot_for_poors_pipeline` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/copilot_for_poors_pipeline_en_5.4.2_3.0_1724685195796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/copilot_for_poors_pipeline_en_5.4.2_3.0_1724685195796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("copilot_for_poors_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("copilot_for_poors_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|copilot_for_poors_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|949.4 MB| + +## References + +https://huggingface.co/Ahmed007/Copilot_for_poors + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-crystal_large_en.md b/docs/_posts/ahmedlone127/2024-08-26-crystal_large_en.md new file mode 100644 index 00000000000000..5753309823ce7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-crystal_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English crystal_large T5Transformer from liujch1998 +author: John Snow Labs +name: crystal_large +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`crystal_large` is a English model originally trained by liujch1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/crystal_large_en_5.4.2_3.0_1724691081994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/crystal_large_en_5.4.2_3.0_1724691081994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("crystal_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("crystal_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|crystal_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/liujch1998/crystal-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_en.md new file mode 100644 index 00000000000000..e18335410d6bee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_en_5.4.2_3.0_1724675516971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_en_5.4.2_3.0_1724675516971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.0 MB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_pipeline_en.md new file mode 100644 index 00000000000000..d9cbbbaea5f8a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs341_camera_coqe_unicoqe_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_pipeline_en_5.4.2_3.0_1724675571571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_pipeline_en_5.4.2_3.0_1724675571571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs341_camera_coqe_unicoqe_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs341_camera_coqe_unicoqe_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.0 MB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_instruction0_aspol_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_instruction0_aspol_en.md new file mode 100644 index 00000000000000..1e6611d9d35117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_instruction0_aspol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_instruction0_aspol T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_instruction0_aspol +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_instruction0_aspol` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction0_aspol_en_5.4.2_3.0_1724659226434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_instruction0_aspol_en_5.4.2_3.0_1724659226434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_instruction0_aspol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_instruction0_aspol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_instruction0_aspol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_Instruction0_ASPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_en.md new file mode 100644 index 00000000000000..e254db454c9d12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_vcheck T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_vcheck +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_vcheck` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_vcheck_en_5.4.2_3.0_1724655754707.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_vcheck_en_5.4.2_3.0_1724655754707.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_vcheck","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_vcheck", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_vcheck| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_vcheck \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline_en.md new file mode 100644 index 00000000000000..81fedf8bcd89ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline_en_5.4.2_3.0_1724655929137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline_en_5.4.2_3.0_1724655929137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_vcheck_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_vcheck + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_en.md new file mode 100644 index 00000000000000..ae8b488dbb2dc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_opsal_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_opsal_v1_h1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_opsal_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opsal_v1_h1_en_5.4.2_3.0_1724661351127.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opsal_v1_h1_en_5.4.2_3.0_1724661351127.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_opsal_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_opsal_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_opsal_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_OPSAL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..f7c9c34036fc04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline_en_5.4.2_3.0_1724661523975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline_en_5.4.2_3.0_1724661523975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_opsal_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_OPSAL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_en.md new file mode 100644 index 00000000000000..897b2c3487d0c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_oaspl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_oaspl_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_oaspl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_oaspl_v1_en_5.4.2_3.0_1724716444645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_oaspl_v1_en_5.4.2_3.0_1724716444645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_oaspl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_oaspl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_oaspl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_OASPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline_en.md new file mode 100644 index 00000000000000..c0f70a7e99d8a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline_en_5.4.2_3.0_1724716621354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline_en_5.4.2_3.0_1724716621354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_oaspl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_OASPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_en.md new file mode 100644 index 00000000000000..047eb3025e66b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal_h1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_h1_en_5.4.2_3.0_1724697356509.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_h1_en_5.4.2_3.0_1724697356509.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline_en.md new file mode 100644 index 00000000000000..4cc9d34552456c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline_en_5.4.2_3.0_1724697530107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline_en_5.4.2_3.0_1724697530107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_en.md new file mode 100644 index 00000000000000..7d4d2a3a63b765 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_soapl_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_soapl_h1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_soapl_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h1_en_5.4.2_3.0_1724703700441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h1_en_5.4.2_3.0_1724703700441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_soapl_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_soapl_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_soapl_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SOAPL_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline_en.md new file mode 100644 index 00000000000000..0d55dea4262fd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline_en_5.4.2_3.0_1724703879995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline_en_5.4.2_3.0_1724703879995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_soapl_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SOAPL_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_en.md new file mode 100644 index 00000000000000..4b38a26549108e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aspol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aspol_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aspol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aspol_v1_en_5.4.2_3.0_1724687675957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aspol_v1_en_5.4.2_3.0_1724687675957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aspol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_aspol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aspol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_ASPOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline_en.md new file mode 100644 index 00000000000000..5f3bade6a152ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline_en_5.4.2_3.0_1724687879599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline_en_5.4.2_3.0_1724687879599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_aspol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_ASPOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_en.md new file mode 100644 index 00000000000000..45b5fad333199f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_opsal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_opsal_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_opsal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_opsal_v1_en_5.4.2_3.0_1724679040349.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_opsal_v1_en_5.4.2_3.0_1724679040349.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_opsal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_opsal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_opsal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OPSAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline_en.md new file mode 100644 index 00000000000000..a04e168d18e4bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline_en_5.4.2_3.0_1724679214435.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline_en_5.4.2_3.0_1724679214435.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_opsal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_OPSAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_en.md new file mode 100644 index 00000000000000..9fd50b03e1d24c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English diabetes_t5_large T5Transformer from ucinlp +author: John Snow Labs +name: diabetes_t5_large +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`diabetes_t5_large` is a English model originally trained by ucinlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/diabetes_t5_large_en_5.4.2_3.0_1724642011378.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/diabetes_t5_large_en_5.4.2_3.0_1724642011378.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("diabetes_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("diabetes_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|diabetes_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ucinlp/diabetes-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..75c8bf2b387747 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-diabetes_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English diabetes_t5_large_pipeline pipeline T5Transformer from ucinlp +author: John Snow Labs +name: diabetes_t5_large_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`diabetes_t5_large_pipeline` is a English model originally trained by ucinlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/diabetes_t5_large_pipeline_en_5.4.2_3.0_1724642153026.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/diabetes_t5_large_pipeline_en_5.4.2_3.0_1724642153026.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("diabetes_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("diabetes_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|diabetes_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ucinlp/diabetes-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_pipeline_zh.md new file mode 100644 index 00000000000000..f19a8af807801a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese dialogue_summary_pipeline pipeline T5Transformer from svjack +author: John Snow Labs +name: dialogue_summary_pipeline +date: 2024-08-26 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary_pipeline` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_pipeline_zh_5.4.2_3.0_1724716061329.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_pipeline_zh_5.4.2_3.0_1724716061329.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialogue_summary_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialogue_summary_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|987.5 MB| + +## References + +https://huggingface.co/svjack/dialogue-summary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_zh.md b/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_zh.md new file mode 100644 index 00000000000000..c76449461fd747 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-dialogue_summary_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese dialogue_summary T5Transformer from svjack +author: John Snow Labs +name: dialogue_summary +date: 2024-08-26 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_zh_5.4.2_3.0_1724716012207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_zh_5.4.2_3.0_1724716012207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialogue_summary","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialogue_summary", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|987.5 MB| + +## References + +https://huggingface.co/svjack/dialogue-summary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_en.md new file mode 100644 index 00000000000000..f90444a12eac0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_05_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_05_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_05_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_05_1_en_5.4.2_3.0_1724693521831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_05_1_en_5.4.2_3.0_1724693521831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_05_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_05_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_05_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.05-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_pipeline_en.md new file mode 100644 index 00000000000000..9d6d5e6788e52d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_0_05_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_05_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_05_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_05_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_05_1_pipeline_en_5.4.2_3.0_1724693711204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_05_1_pipeline_en_5.4.2_3.0_1724693711204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_05_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_05_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_05_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.05-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_en.md new file mode 100644 index 00000000000000..a0a0d51534c3d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_1_2 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1_2` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_2_en_5.4.2_3.0_1724705767515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_2_en_5.4.2_3.0_1724705767515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_1_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_1_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_pipeline_en.md new file mode 100644 index 00000000000000..057d6e975e34b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_1_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_1_2_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1_2_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_2_pipeline_en_5.4.2_3.0_1724705959964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1_2_pipeline_en_5.4.2_3.0_1724705959964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_1_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_1_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_en.md new file mode 100644 index 00000000000000..8733412cb32bb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b0_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_1_en_5.4.2_3.0_1724705380782.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_1_en_5.4.2_3.0_1724705380782.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b0_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b0_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_pipeline_en.md new file mode 100644 index 00000000000000..d800fa859cb6d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b0_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b0_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_1_pipeline_en_5.4.2_3.0_1724705572228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_1_pipeline_en_5.4.2_3.0_1724705572228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b0_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b0_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_en.md new file mode 100644 index 00000000000000..fa8e7e487dfcba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b20 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b20 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b20` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b20_en_5.4.2_3.0_1724693830140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b20_en_5.4.2_3.0_1724693830140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_pipeline_en.md new file mode 100644 index 00000000000000..9cbb32f3d277dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_b20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b20_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b20_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b20_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b20_pipeline_en_5.4.2_3.0_1724694019771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b20_pipeline_en_5.4.2_3.0_1724694019771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_en.md new file mode 100644 index 00000000000000..b8599ca79fd077 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small T5Transformer from alifaheem94 +author: John Snow Labs +name: distilled_mt5_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small` is a English model originally trained by alifaheem94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_en_5.4.2_3.0_1724640250288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_en_5.4.2_3.0_1724640250288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|108.9 MB| + +## References + +https://huggingface.co/alifaheem94/distilled-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_pipeline_en.md new file mode 100644 index 00000000000000..0d5921f7e4e365 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-distilled_mt5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_pipeline pipeline T5Transformer from alifaheem94 +author: John Snow Labs +name: distilled_mt5_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_pipeline` is a English model originally trained by alifaheem94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_pipeline_en_5.4.2_3.0_1724640288043.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_pipeline_en_5.4.2_3.0_1724640288043.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|108.9 MB| + +## References + +https://huggingface.co/alifaheem94/distilled-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_en.md b/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_en.md new file mode 100644 index 00000000000000..08e90316156d16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English doc2query_ppo_msmarco_100_12n T5Transformer from Hermi2023 +author: John Snow Labs +name: doc2query_ppo_msmarco_100_12n +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_ppo_msmarco_100_12n` is a English model originally trained by Hermi2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_100_12n_en_5.4.2_3.0_1724671609341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_100_12n_en_5.4.2_3.0_1724671609341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("doc2query_ppo_msmarco_100_12n","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("doc2query_ppo_msmarco_100_12n", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_ppo_msmarco_100_12n| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|954.6 MB| + +## References + +https://huggingface.co/Hermi2023/doc2query-ppo-msmarco-100-12n \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_pipeline_en.md new file mode 100644 index 00000000000000..cdc9ee8191450f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-doc2query_ppo_msmarco_100_12n_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English doc2query_ppo_msmarco_100_12n_pipeline pipeline T5Transformer from Hermi2023 +author: John Snow Labs +name: doc2query_ppo_msmarco_100_12n_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doc2query_ppo_msmarco_100_12n_pipeline` is a English model originally trained by Hermi2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_100_12n_pipeline_en_5.4.2_3.0_1724671671388.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doc2query_ppo_msmarco_100_12n_pipeline_en_5.4.2_3.0_1724671671388.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("doc2query_ppo_msmarco_100_12n_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("doc2query_ppo_msmarco_100_12n_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doc2query_ppo_msmarco_100_12n_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|954.6 MB| + +## References + +https://huggingface.co/Hermi2023/doc2query-ppo-msmarco-100-12n + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_en.md b/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_en.md new file mode 100644 index 00000000000000..9551eff56daa69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English doct5_nq320k T5Transformer from namespace-Pt +author: John Snow Labs +name: doct5_nq320k +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doct5_nq320k` is a English model originally trained by namespace-Pt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doct5_nq320k_en_5.4.2_3.0_1724676210219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doct5_nq320k_en_5.4.2_3.0_1724676210219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("doct5_nq320k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("doct5_nq320k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doct5_nq320k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/namespace-Pt/doct5-nq320k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_pipeline_en.md new file mode 100644 index 00000000000000..9d70765582b8bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-doct5_nq320k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English doct5_nq320k_pipeline pipeline T5Transformer from namespace-Pt +author: John Snow Labs +name: doct5_nq320k_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`doct5_nq320k_pipeline` is a English model originally trained by namespace-Pt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/doct5_nq320k_pipeline_en_5.4.2_3.0_1724676258217.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/doct5_nq320k_pipeline_en_5.4.2_3.0_1724676258217.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("doct5_nq320k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("doct5_nq320k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|doct5_nq320k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/namespace-Pt/doct5-nq320k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_en.md b/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_en.md new file mode 100644 index 00000000000000..ed23afc80a4abc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English docut5_small_sindhi_dates T5Transformer from totem37 +author: John Snow Labs +name: docut5_small_sindhi_dates +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`docut5_small_sindhi_dates` is a English model originally trained by totem37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/docut5_small_sindhi_dates_en_5.4.2_3.0_1724704181581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/docut5_small_sindhi_dates_en_5.4.2_3.0_1724704181581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("docut5_small_sindhi_dates","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("docut5_small_sindhi_dates", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|docut5_small_sindhi_dates| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/totem37/DocuT5-Small-SD-Dates \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_pipeline_en.md new file mode 100644 index 00000000000000..5c8e6d629c9b97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-docut5_small_sindhi_dates_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English docut5_small_sindhi_dates_pipeline pipeline T5Transformer from totem37 +author: John Snow Labs +name: docut5_small_sindhi_dates_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`docut5_small_sindhi_dates_pipeline` is a English model originally trained by totem37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/docut5_small_sindhi_dates_pipeline_en_5.4.2_3.0_1724704198322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/docut5_small_sindhi_dates_pipeline_en_5.4.2_3.0_1724704198322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("docut5_small_sindhi_dates_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("docut5_small_sindhi_dates_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|docut5_small_sindhi_dates_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/totem37/DocuT5-Small-SD-Dates + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_nl.md b/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_nl.md new file mode 100644 index 00000000000000..e0e0274f02c140 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_nl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Dutch, Flemish dutch_restaurant_mt5_small T5Transformer from NUSTM +author: John Snow Labs +name: dutch_restaurant_mt5_small +date: 2024-08-26 +tags: [nl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_restaurant_mt5_small` is a Dutch, Flemish model originally trained by NUSTM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_restaurant_mt5_small_nl_5.4.2_3.0_1724690756413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_restaurant_mt5_small_nl_5.4.2_3.0_1724690756413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_restaurant_mt5_small","nl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_restaurant_mt5_small", "nl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_restaurant_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nl| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NUSTM/dutch-restaurant-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_pipeline_nl.md b/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_pipeline_nl.md new file mode 100644 index 00000000000000..bdef694666cf8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-dutch_restaurant_mt5_small_pipeline_nl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Dutch, Flemish dutch_restaurant_mt5_small_pipeline pipeline T5Transformer from NUSTM +author: John Snow Labs +name: dutch_restaurant_mt5_small_pipeline +date: 2024-08-26 +tags: [nl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_restaurant_mt5_small_pipeline` is a Dutch, Flemish model originally trained by NUSTM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_restaurant_mt5_small_pipeline_nl_5.4.2_3.0_1724690940905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_restaurant_mt5_small_pipeline_nl_5.4.2_3.0_1724690940905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_restaurant_mt5_small_pipeline", lang = "nl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_restaurant_mt5_small_pipeline", lang = "nl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_restaurant_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nl| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NUSTM/dutch-restaurant-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_en.md new file mode 100644 index 00000000000000..4d98dd231b3408 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_dholuo_maltese_v1 T5Transformer from Alphonse-96 +author: John Snow Labs +name: english_dholuo_maltese_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_dholuo_maltese_v1` is a English model originally trained by Alphonse-96. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_dholuo_maltese_v1_en_5.4.2_3.0_1724633162872.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_dholuo_maltese_v1_en_5.4.2_3.0_1724633162872.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_dholuo_maltese_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_dholuo_maltese_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_dholuo_maltese_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Alphonse-96/en_luo_mt_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_pipeline_en.md new file mode 100644 index 00000000000000..b51d59de89d7b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_dholuo_maltese_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_dholuo_maltese_v1_pipeline pipeline T5Transformer from Alphonse-96 +author: John Snow Labs +name: english_dholuo_maltese_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_dholuo_maltese_v1_pipeline` is a English model originally trained by Alphonse-96. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_dholuo_maltese_v1_pipeline_en_5.4.2_3.0_1724633210806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_dholuo_maltese_v1_pipeline_en_5.4.2_3.0_1724633210806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_dholuo_maltese_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_dholuo_maltese_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_dholuo_maltese_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Alphonse-96/en_luo_mt_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_en.md new file mode 100644 index 00000000000000..468032d336968b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_mt5_base_15_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_base_15_wikisql +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_base_15_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_base_15_wikisql_en_5.4.2_3.0_1724711567384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_base_15_wikisql_en_5.4.2_3.0_1724711567384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_mt5_base_15_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_mt5_base_15_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_base_15_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-base_15_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_pipeline_en.md new file mode 100644 index 00000000000000..19e20c75a8fdd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_mt5_base_15_wikisql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_mt5_base_15_wikisql_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_base_15_wikisql_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_base_15_wikisql_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_base_15_wikisql_pipeline_en_5.4.2_3.0_1724711858354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_base_15_wikisql_pipeline_en_5.4.2_3.0_1724711858354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_mt5_base_15_wikisql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_mt5_base_15_wikisql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_base_15_wikisql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-base_15_wikiSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_en.md new file mode 100644 index 00000000000000..543061c1b534dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5_base_15_spider T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_base_15_spider +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_base_15_spider` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_en_5.4.2_3.0_1724682596121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_en_5.4.2_3.0_1724682596121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5_base_15_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5_base_15_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_base_15_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.2 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-base_15_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_pipeline_en.md new file mode 100644 index 00000000000000..9ae0eacff8e7dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-english_t5_base_15_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5_base_15_spider_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_base_15_spider_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_base_15_spider_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_pipeline_en_5.4.2_3.0_1724682654065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_pipeline_en_5.4.2_3.0_1724682654065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5_base_15_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5_base_15_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_base_15_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.2 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-base_15_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_en.md new file mode 100644 index 00000000000000..2a8462b7a5aff0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English essay_generator_v1 T5Transformer from justinlamlamlam +author: John Snow Labs +name: essay_generator_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`essay_generator_v1` is a English model originally trained by justinlamlamlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/essay_generator_v1_en_5.4.2_3.0_1724706995044.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/essay_generator_v1_en_5.4.2_3.0_1724706995044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("essay_generator_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("essay_generator_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|essay_generator_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/justinlamlamlam/essay_generator_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_pipeline_en.md new file mode 100644 index 00000000000000..7fa327a3e22a90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-essay_generator_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English essay_generator_v1_pipeline pipeline T5Transformer from justinlamlamlam +author: John Snow Labs +name: essay_generator_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`essay_generator_v1_pipeline` is a English model originally trained by justinlamlamlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/essay_generator_v1_pipeline_en_5.4.2_3.0_1724707012303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/essay_generator_v1_pipeline_en_5.4.2_3.0_1724707012303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("essay_generator_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("essay_generator_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|essay_generator_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/justinlamlamlam/essay_generator_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-fine_tuned_t5_russian_en.md b/docs/_posts/ahmedlone127/2024-08-26-fine_tuned_t5_russian_en.md new file mode 100644 index 00000000000000..00cf16009c604e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-fine_tuned_t5_russian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_t5_russian T5Transformer from AlekseyElygin +author: John Snow Labs +name: fine_tuned_t5_russian +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_t5_russian` is a English model originally trained by AlekseyElygin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_russian_en_5.4.2_3.0_1724671450274.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_russian_en_5.4.2_3.0_1724671450274.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_t5_russian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_t5_russian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_t5_russian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.9 GB| + +## References + +https://huggingface.co/AlekseyElygin/fine-tuned-t5-russian \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..d07babbf470553 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_summarization_malay_t5_small_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_summarization_malay_t5_small_standard_bahasa_cased +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_summarization_malay_t5_small_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_summarization_malay_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724702356514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_summarization_malay_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724702356514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_summarization_malay_t5_small_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_summarization_malay_t5_small_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_summarization_malay_t5_small_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-summarization-ms-t5-small-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..5f66d0124fdca1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724702373647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724702373647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_summarization_malay_t5_small_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-summarization-ms-t5-small-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..aee411d7bf0d49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_ttkg_t5_small_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_ttkg_t5_small_standard_bahasa_cased +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_ttkg_t5_small_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_ttkg_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724636478033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_ttkg_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724636478033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_ttkg_t5_small_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_ttkg_t5_small_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_ttkg_t5_small_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-ttkg-t5-small-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..c4301554a0072b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-finetune_ttkg_t5_small_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_ttkg_t5_small_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_ttkg_t5_small_standard_bahasa_cased_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_ttkg_t5_small_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_ttkg_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724636494828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_ttkg_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724636494828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_ttkg_t5_small_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_ttkg_t5_small_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_ttkg_t5_small_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-ttkg-t5-small-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_en.md new file mode 100644 index 00000000000000..ca3810271d0723 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fix_punct_uncased_t5_small T5Transformer from nbroad +author: John Snow Labs +name: fix_punct_uncased_t5_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fix_punct_uncased_t5_small` is a English model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fix_punct_uncased_t5_small_en_5.4.2_3.0_1724662972961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fix_punct_uncased_t5_small_en_5.4.2_3.0_1724662972961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fix_punct_uncased_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fix_punct_uncased_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fix_punct_uncased_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.2 MB| + +## References + +https://huggingface.co/nbroad/fix_punct_uncased_t5_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..98e8c36f07c40d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-fix_punct_uncased_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fix_punct_uncased_t5_small_pipeline pipeline T5Transformer from nbroad +author: John Snow Labs +name: fix_punct_uncased_t5_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fix_punct_uncased_t5_small_pipeline` is a English model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fix_punct_uncased_t5_small_pipeline_en_5.4.2_3.0_1724662990180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fix_punct_uncased_t5_small_pipeline_en_5.4.2_3.0_1724662990180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fix_punct_uncased_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fix_punct_uncased_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fix_punct_uncased_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.2 MB| + +## References + +https://huggingface.co/nbroad/fix_punct_uncased_t5_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_en.md new file mode 100644 index 00000000000000..151744499e2dbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_attitude_base T5Transformer from dpasch01 +author: John Snow Labs +name: flan_attitude_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_attitude_base` is a English model originally trained by dpasch01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_attitude_base_en_5.4.2_3.0_1724665156083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_attitude_base_en_5.4.2_3.0_1724665156083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_attitude_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_attitude_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_attitude_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dpasch01/flan-attitude-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_pipeline_en.md new file mode 100644 index 00000000000000..8a40778eab2d11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_attitude_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_attitude_base_pipeline pipeline T5Transformer from dpasch01 +author: John Snow Labs +name: flan_attitude_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_attitude_base_pipeline` is a English model originally trained by dpasch01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_attitude_base_pipeline_en_5.4.2_3.0_1724665202520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_attitude_base_pipeline_en_5.4.2_3.0_1724665202520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_attitude_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_attitude_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_attitude_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dpasch01/flan-attitude-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_en.md new file mode 100644 index 00000000000000..3caff64f9df8d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_clang8_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_clang8_e8_b16 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_clang8_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e8_b16_en_5.4.2_3.0_1724646790852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e8_b16_en_5.4.2_3.0_1724646790852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_clang8_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_clang8_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_clang8_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-clang8-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..5e05a13d866485 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_clang8_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_clang8_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_clang8_e8_b16_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_clang8_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e8_b16_pipeline_en_5.4.2_3.0_1724646837699.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e8_b16_pipeline_en_5.4.2_3.0_1724646837699.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_clang8_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_clang8_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_clang8_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-clang8-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_en.md new file mode 100644 index 00000000000000..820844694b2c9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_en_5.4.2_3.0_1724691259324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_en_5.4.2_3.0_1724691259324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_20000-all-hint_precision-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline_en.md new file mode 100644 index 00000000000000..24a840afad30ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724691307473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724691307473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_20000_all_hint_precision_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_20000-all-hint_precision-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_en.md new file mode 100644 index 00000000000000..8ee5ded8b6f406 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem T5Transformer from agnesem +author: John Snow Labs +name: flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem` is a English model originally trained by agnesem. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_en_5.4.2_3.0_1724670663638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_en_5.4.2_3.0_1724670663638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.2 MB| + +## References + +https://huggingface.co/agnesem/flan_t5_base_finetuned_MTS_clinical_adj_unique_dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline_en.md new file mode 100644 index 00000000000000..f965a1e3be746c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline pipeline T5Transformer from agnesem +author: John Snow Labs +name: flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline` is a English model originally trained by agnesem. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline_en_5.4.2_3.0_1724670842856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline_en_5.4.2_3.0_1724670842856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_mts_clinical_adj_unique_dialogue_agnesem_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.2 MB| + +## References + +https://huggingface.co/agnesem/flan_t5_base_finetuned_MTS_clinical_adj_unique_dialogue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_en.md new file mode 100644 index 00000000000000..fb10c4202cac15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_summaries_predicts T5Transformer from ViktorDo +author: John Snow Labs +name: flan_t5_base_finetuned_summaries_predicts +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_summaries_predicts` is a English model originally trained by ViktorDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_predicts_en_5.4.2_3.0_1724686641175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_predicts_en_5.4.2_3.0_1724686641175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_summaries_predicts","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_summaries_predicts", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_summaries_predicts| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ViktorDo/flan-t5-base-finetuned-summaries-PREDICTS \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_pipeline_en.md new file mode 100644 index 00000000000000..544d8e30161878 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_finetuned_summaries_predicts_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_summaries_predicts_pipeline pipeline T5Transformer from ViktorDo +author: John Snow Labs +name: flan_t5_base_finetuned_summaries_predicts_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_summaries_predicts_pipeline` is a English model originally trained by ViktorDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_predicts_pipeline_en_5.4.2_3.0_1724686689275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_summaries_predicts_pipeline_en_5.4.2_3.0_1724686689275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_summaries_predicts_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_summaries_predicts_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_summaries_predicts_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ViktorDo/flan-t5-base-finetuned-summaries-PREDICTS + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_es.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_es.md new file mode 100644 index 00000000000000..91ec33b3808c91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish flan_t5_base_spanish_english T5Transformer from dandrade +author: John Snow Labs +name: flan_t5_base_spanish_english +date: 2024-08-26 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_spanish_english` is a Castilian, Spanish model originally trained by dandrade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_spanish_english_es_5.4.2_3.0_1724680055747.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_spanish_english_es_5.4.2_3.0_1724680055747.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_spanish_english","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_spanish_english", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_spanish_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dandrade/flan-t5-base-es-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_pipeline_es.md new file mode 100644 index 00000000000000..24d382e3839779 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_spanish_english_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish flan_t5_base_spanish_english_pipeline pipeline T5Transformer from dandrade +author: John Snow Labs +name: flan_t5_base_spanish_english_pipeline +date: 2024-08-26 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_spanish_english_pipeline` is a Castilian, Spanish model originally trained by dandrade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_spanish_english_pipeline_es_5.4.2_3.0_1724680102437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_spanish_english_pipeline_es_5.4.2_3.0_1724680102437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_spanish_english_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_spanish_english_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_spanish_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dandrade/flan-t5-base-es-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_squad_ae_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_squad_ae_pipeline_en.md new file mode 100644 index 00000000000000..46f9dffbf9edb9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_squad_ae_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_squad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_base_squad_ae_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_ae_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_ae_pipeline_en_5.4.2_3.0_1724685080788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_ae_pipeline_en_5.4.2_3.0_1724685080788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_squad_ae_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_squad_ae_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lmqg/flan-t5-base-squad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_en.md new file mode 100644 index 00000000000000..f8d71ca19e58dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_nerd T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_nerd +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_nerd` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_nerd_en_5.4.2_3.0_1724698777120.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_nerd_en_5.4.2_3.0_1724698777120.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_nerd","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_nerd", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_nerd| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-nerd \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_pipeline_en.md new file mode 100644 index 00000000000000..9d9de042da9713 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_base_tweet_nerd_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_nerd_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_nerd_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_nerd_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_nerd_pipeline_en_5.4.2_3.0_1724698830619.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_nerd_pipeline_en_5.4.2_3.0_1724698830619.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_nerd_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_nerd_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_nerd_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-nerd + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_en.md new file mode 100644 index 00000000000000..b5339bcc3c9f12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr1e_4 T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr1e_4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr1e_4` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr1e_4_en_5.4.2_3.0_1724702698979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr1e_4_en_5.4.2_3.0_1724702698979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr1e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr1e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr1e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr1e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_pipeline_en.md new file mode 100644 index 00000000000000..92e4b012b4da02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_glue_finetuning_lr1e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr1e_4_pipeline pipeline T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr1e_4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr1e_4_pipeline` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr1e_4_pipeline_en_5.4.2_3.0_1724702747632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr1e_4_pipeline_en_5.4.2_3.0_1724702747632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_glue_finetuning_lr1e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_glue_finetuning_lr1e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr1e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr1e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop_en.md new file mode 100644 index 00000000000000..31a13edda7ecf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop_en_5.4.2_3.0_1724644049728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop_en_5.4.2_3.0_1724644049728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep10_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep10-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_en.md new file mode 100644 index 00000000000000..c7ba895c47550e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_en_5.4.2_3.0_1724665725271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_en_5.4.2_3.0_1724665725271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep7-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..aa0e398b889b43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline_en_5.4.2_3.0_1724665863132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline_en_5.4.2_3.0_1724665863132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep7_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep7-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_en.md new file mode 100644 index 00000000000000..3342e9131c8a5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_en_5.4.2_3.0_1724705393186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_en_5.4.2_3.0_1724705393186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_800-ep8-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..24e5b791e3d56c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline_en_5.4.2_3.0_1724705530508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline_en_5.4.2_3.0_1724705530508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_800_ep8_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_800-ep8-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_en.md new file mode 100644 index 00000000000000..26f7d0f288a8cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_en_5.4.2_3.0_1724658452205.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_en_5.4.2_3.0_1724658452205.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_1000-ep5-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..5979825e44a61b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline_en_5.4.2_3.0_1724658591294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline_en_5.4.2_3.0_1724658591294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_1000_ep5_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_1000-ep5-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_en.md new file mode 100644 index 00000000000000..a8cf882ad26b29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_en_5.4.2_3.0_1724661896371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_en_5.4.2_3.0_1724661896371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_pipeline_en.md new file mode 100644 index 00000000000000..831248bc5b5b45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_extraction_cnndm_2000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_pipeline_en_5.4.2_3.0_1724662046213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_pipeline_en_5.4.2_3.0_1724662046213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_en.md new file mode 100644 index 00000000000000..696479d7fa5a0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_finetuned_melanocytic_lesion_reports T5Transformer from RTLucassen +author: John Snow Labs +name: flan_t5_large_finetuned_melanocytic_lesion_reports +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_finetuned_melanocytic_lesion_reports` is a English model originally trained by RTLucassen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_melanocytic_lesion_reports_en_5.4.2_3.0_1724684202748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_melanocytic_lesion_reports_en_5.4.2_3.0_1724684202748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_finetuned_melanocytic_lesion_reports","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_finetuned_melanocytic_lesion_reports", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_finetuned_melanocytic_lesion_reports| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/RTLucassen/flan-t5-large-finetuned-melanocytic-lesion-reports \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline_en.md new file mode 100644 index 00000000000000..c82540229068cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline pipeline T5Transformer from RTLucassen +author: John Snow Labs +name: flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline` is a English model originally trained by RTLucassen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline_en_5.4.2_3.0_1724684414318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline_en_5.4.2_3.0_1724684414318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_finetuned_melanocytic_lesion_reports_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/RTLucassen/flan-t5-large-finetuned-melanocytic-lesion-reports + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_dialogue_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_dialogue_en.md new file mode 100644 index 00000000000000..1ef4365eca7449 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_dialogue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_finetuned_mts_dialogue T5Transformer from hankym +author: John Snow Labs +name: flan_t5_large_finetuned_mts_dialogue +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_finetuned_mts_dialogue` is a English model originally trained by hankym. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_mts_dialogue_en_5.4.2_3.0_1724645230204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_mts_dialogue_en_5.4.2_3.0_1724645230204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_finetuned_mts_dialogue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_finetuned_mts_dialogue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_finetuned_mts_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/hankym/flan_t5_large_finetuned_MTS_dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_ner_clinical_dialogue_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_ner_clinical_dialogue_en.md new file mode 100644 index 00000000000000..f8a5f5c4d9c636 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_finetuned_mts_ner_clinical_dialogue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_finetuned_mts_ner_clinical_dialogue T5Transformer from hankym +author: John Snow Labs +name: flan_t5_large_finetuned_mts_ner_clinical_dialogue +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_finetuned_mts_ner_clinical_dialogue` is a English model originally trained by hankym. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_mts_ner_clinical_dialogue_en_5.4.2_3.0_1724651181693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_finetuned_mts_ner_clinical_dialogue_en_5.4.2_3.0_1724651181693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_finetuned_mts_ner_clinical_dialogue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_finetuned_mts_ner_clinical_dialogue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_finetuned_mts_ner_clinical_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/hankym/flan_t5_large_finetuned_MTS_NER_Clinical_dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_en.md new file mode 100644 index 00000000000000..7b4d0ddce95af3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_fold_1 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_large_fold_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fold_1` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_1_en_5.4.2_3.0_1724713626006.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_1_en_5.4.2_3.0_1724713626006.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_fold_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_fold_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fold_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-large_fold_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_pipeline_en.md new file mode 100644 index 00000000000000..77eb6135e8d3ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_fold_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_fold_1_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_large_fold_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fold_1_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_1_pipeline_en_5.4.2_3.0_1724714151531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_1_pipeline_en_5.4.2_3.0_1724714151531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_fold_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_fold_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fold_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-large_fold_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_en.md new file mode 100644 index 00000000000000..e3c40f54b66ce0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_55_ep20 T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_55_ep20 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_55_ep20` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_55_ep20_en_5.4.2_3.0_1724715381878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_55_ep20_en_5.4.2_3.0_1724715381878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_55_ep20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_55_ep20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_55_ep20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_55_ep20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_pipeline_en.md new file mode 100644 index 00000000000000..6fa7d27300b978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_medistill_55_ep20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_55_ep20_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_55_ep20_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_55_ep20_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_55_ep20_pipeline_en_5.4.2_3.0_1724715521679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_55_ep20_pipeline_en_5.4.2_3.0_1724715521679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_55_ep20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_55_ep20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_55_ep20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_55_ep20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_squad_qag_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_squad_qag_en.md new file mode 100644 index 00000000000000..e7ecf21704d04d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_squad_qag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_squad_qag T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_large_squad_qag +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_squad_qag` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_en_5.4.2_3.0_1724632465813.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_qag_en_5.4.2_3.0_1724632465813.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_squad_qag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_squad_qag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_squad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lmqg/flan-t5-large-squad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_vg_factual_sango_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_vg_factual_sango_en.md new file mode 100644 index 00000000000000..bd780272164cb2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_large_vg_factual_sango_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_vg_factual_sango T5Transformer from lizhuang144 +author: John Snow Labs +name: flan_t5_large_vg_factual_sango +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_vg_factual_sango` is a English model originally trained by lizhuang144. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_vg_factual_sango_en_5.4.2_3.0_1724664506571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_vg_factual_sango_en_5.4.2_3.0_1724664506571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_vg_factual_sango","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_vg_factual_sango", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_vg_factual_sango| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lizhuang144/flan-t5-large-VG-factual-sg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_en.md new file mode 100644 index 00000000000000..ba61030c0fd5ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_2_6_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_2_6_cnndm +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_2_6_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_cnndm_en_5.4.2_3.0_1724650852945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_cnndm_en_5.4.2_3.0_1724650852945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_2_6_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_2_6_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_2_6_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|296.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-2-6-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..8ecff20bc6bde1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_2_6_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_2_6_cnndm_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_2_6_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_cnndm_pipeline_en_5.4.2_3.0_1724650867725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_cnndm_pipeline_en_5.4.2_3.0_1724650867725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_2_6_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_2_6_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_2_6_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|296.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-2-6-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_en.md new file mode 100644 index 00000000000000..9b37645fe70cf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_2_6_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_2_6_xsum +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_2_6_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_xsum_en_5.4.2_3.0_1724701914191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_xsum_en_5.4.2_3.0_1724701914191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_2_6_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_2_6_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_2_6_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|296.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-2-6-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_pipeline_en.md new file mode 100644 index 00000000000000..5c008aa75ddf0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_2_6_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_2_6_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_2_6_xsum_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_2_6_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_xsum_pipeline_en_5.4.2_3.0_1724701928439.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_2_6_xsum_pipeline_en_5.4.2_3.0_1724701928439.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_2_6_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_2_6_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_2_6_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|296.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-2-6-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_en.md new file mode 100644 index 00000000000000..39cd2db45ec861 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_5_5_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_5_5_xsum +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_5_5_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_5_5_xsum_en_5.4.2_3.0_1724664943404.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_5_5_xsum_en_5.4.2_3.0_1724664943404.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_5_5_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_5_5_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_5_5_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.5 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-5-5-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_pipeline_en.md new file mode 100644 index 00000000000000..4a63f3f36a0a18 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_5_5_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_5_5_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_5_5_xsum_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_5_5_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_5_5_xsum_pipeline_en_5.4.2_3.0_1724664958138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_5_5_xsum_pipeline_en_5.4.2_3.0_1724664958138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_5_5_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_5_5_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_5_5_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.5 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-5-5-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_en.md new file mode 100644 index 00000000000000..64ed2c8ac7cd17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_6_3_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_3_cnndm +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_3_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_cnndm_en_5.4.2_3.0_1724651024960.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_cnndm_en_5.4.2_3.0_1724651024960.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_6_3_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_6_3_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_3_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-3-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..eadaa7b4785f05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_6_3_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_6_3_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_3_cnndm_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_3_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_cnndm_pipeline_en_5.4.2_3.0_1724651039338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_3_cnndm_pipeline_en_5.4.2_3.0_1724651039338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_6_3_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_6_3_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_3_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-3-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_en.md new file mode 100644 index 00000000000000..9f9dcd6a3f948a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t5_f0_prompt_adherence T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t5_f0_prompt_adherence +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t5_f0_prompt_adherence` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t5_f0_prompt_adherence_en_5.4.2_3.0_1724712797680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t5_f0_prompt_adherence_en_5.4.2_3.0_1724712797680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t5_f0_prompt_adherence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t5_f0_prompt_adherence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t5_f0_prompt_adherence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t5_f0_prompt_adherence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_pipeline_en.md new file mode 100644 index 00000000000000..4c7ef9f4e0d270 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_asap_t5_f0_prompt_adherence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t5_f0_prompt_adherence_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t5_f0_prompt_adherence_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t5_f0_prompt_adherence_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t5_f0_prompt_adherence_pipeline_en_5.4.2_3.0_1724712814764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t5_f0_prompt_adherence_pipeline_en_5.4.2_3.0_1724712814764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t5_f0_prompt_adherence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t5_f0_prompt_adherence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t5_f0_prompt_adherence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t5_f0_prompt_adherence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_en.md new file mode 100644 index 00000000000000..163895a57da677 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_coqa_v0_2 T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_small_finetuned_coqa_v0_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_coqa_v0_2` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_2_en_5.4.2_3.0_1724666529384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_2_en_5.4.2_3.0_1724666529384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_coqa_v0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_coqa_v0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_coqa_v0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-small-finetuned-coqa-V0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_pipeline_en.md new file mode 100644 index 00000000000000..f0ede859a69775 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_coqa_v0_2_pipeline pipeline T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_small_finetuned_coqa_v0_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_coqa_v0_2_pipeline` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_2_pipeline_en_5.4.2_3.0_1724666547204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_2_pipeline_en_5.4.2_3.0_1724666547204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_coqa_v0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_coqa_v0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_coqa_v0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-small-finetuned-coqa-V0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_en.md new file mode 100644 index 00000000000000..45ec306e61200d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_coqa_v0_7 T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_small_finetuned_coqa_v0_7 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_coqa_v0_7` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_7_en_5.4.2_3.0_1724704185078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_7_en_5.4.2_3.0_1724704185078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_coqa_v0_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_coqa_v0_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_coqa_v0_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-small-finetuned-coqa-V0.7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_pipeline_en.md new file mode 100644 index 00000000000000..c25fcc6ea93433 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_finetuned_coqa_v0_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_coqa_v0_7_pipeline pipeline T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_small_finetuned_coqa_v0_7_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_coqa_v0_7_pipeline` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_7_pipeline_en_5.4.2_3.0_1724704201514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_coqa_v0_7_pipeline_en_5.4.2_3.0_1724704201514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_coqa_v0_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_coqa_v0_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_coqa_v0_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-small-finetuned-coqa-V0.7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_en.md new file mode 100644 index 00000000000000..b41fc1a84ceeff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_gizmo_ai T5Transformer from gizmo-ai +author: John Snow Labs +name: flan_t5_small_gizmo_ai +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_gizmo_ai` is a English model originally trained by gizmo-ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_gizmo_ai_en_5.4.2_3.0_1724637278996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_gizmo_ai_en_5.4.2_3.0_1724637278996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_gizmo_ai","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_gizmo_ai", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_gizmo_ai| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/gizmo-ai/flan-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_pipeline_en.md new file mode 100644 index 00000000000000..f0db21e40d5772 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_gizmo_ai_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_gizmo_ai_pipeline pipeline T5Transformer from gizmo-ai +author: John Snow Labs +name: flan_t5_small_gizmo_ai_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_gizmo_ai_pipeline` is a English model originally trained by gizmo-ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_gizmo_ai_pipeline_en_5.4.2_3.0_1724637295580.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_gizmo_ai_pipeline_en_5.4.2_3.0_1724637295580.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_gizmo_ai_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_gizmo_ai_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_gizmo_ai_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/gizmo-ai/flan-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_en.md new file mode 100644 index 00000000000000..231268d1ec3b1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_garell T5Transformer from Garell +author: John Snow Labs +name: flan_t5_small_samsum_garell +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_garell` is a English model originally trained by Garell. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_garell_en_5.4.2_3.0_1724698382473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_garell_en_5.4.2_3.0_1724698382473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_garell","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_garell", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_garell| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Garell/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_pipeline_en.md new file mode 100644 index 00000000000000..5cdc7d239f5d4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_garell_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_garell_pipeline pipeline T5Transformer from Garell +author: John Snow Labs +name: flan_t5_small_samsum_garell_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_garell_pipeline` is a English model originally trained by Garell. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_garell_pipeline_en_5.4.2_3.0_1724698400316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_garell_pipeline_en_5.4.2_3.0_1724698400316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_garell_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_garell_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_garell_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Garell/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_en.md new file mode 100644 index 00000000000000..5577cf57ec511d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_jrdndj T5Transformer from jrdndj +author: John Snow Labs +name: flan_t5_small_samsum_jrdndj +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_jrdndj` is a English model originally trained by jrdndj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_jrdndj_en_5.4.2_3.0_1724712932505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_jrdndj_en_5.4.2_3.0_1724712932505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_jrdndj","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_jrdndj", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_jrdndj| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/jrdndj/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_pipeline_en.md new file mode 100644 index 00000000000000..f038896aa78795 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_jrdndj_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_jrdndj_pipeline pipeline T5Transformer from jrdndj +author: John Snow Labs +name: flan_t5_small_samsum_jrdndj_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_jrdndj_pipeline` is a English model originally trained by jrdndj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_jrdndj_pipeline_en_5.4.2_3.0_1724712949610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_jrdndj_pipeline_en_5.4.2_3.0_1724712949610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_jrdndj_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_jrdndj_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_jrdndj_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/jrdndj/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_en.md new file mode 100644 index 00000000000000..cf314324d468a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_nikolamurgo T5Transformer from nikolamurgo +author: John Snow Labs +name: flan_t5_small_samsum_nikolamurgo +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_nikolamurgo` is a English model originally trained by nikolamurgo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_nikolamurgo_en_5.4.2_3.0_1724702410473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_nikolamurgo_en_5.4.2_3.0_1724702410473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_nikolamurgo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_nikolamurgo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_nikolamurgo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/nikolamurgo/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_pipeline_en.md new file mode 100644 index 00000000000000..21835878ff2685 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_samsum_nikolamurgo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_nikolamurgo_pipeline pipeline T5Transformer from nikolamurgo +author: John Snow Labs +name: flan_t5_small_samsum_nikolamurgo_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_nikolamurgo_pipeline` is a English model originally trained by nikolamurgo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_nikolamurgo_pipeline_en_5.4.2_3.0_1724702427800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_nikolamurgo_pipeline_en_5.4.2_3.0_1724702427800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_nikolamurgo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_nikolamurgo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_nikolamurgo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/nikolamurgo/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_en.md new file mode 100644 index 00000000000000..3cffc9d78ff84b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_tweet_emoji T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tweet_emoji +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tweet_emoji` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_emoji_en_5.4.2_3.0_1724650035839.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_emoji_en_5.4.2_3.0_1724650035839.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_tweet_emoji","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_tweet_emoji", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tweet_emoji| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tweet-emoji \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_pipeline_en.md new file mode 100644 index 00000000000000..239d10f1d4ef3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_small_tweet_emoji_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_tweet_emoji_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tweet_emoji_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tweet_emoji_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_emoji_pipeline_en_5.4.2_3.0_1724650052308.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_emoji_pipeline_en_5.4.2_3.0_1724650052308.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_tweet_emoji_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_tweet_emoji_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tweet_emoji_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tweet-emoji + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_en.md new file mode 100644 index 00000000000000..74e58b36f38859 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_mlm_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_mlm_w_context_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_mlm_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_w_context_small_en_5.4.2_3.0_1724662058068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_w_context_small_en_5.4.2_3.0_1724662058068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_mlm_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_mlm_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_mlm_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-mlm-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..403a8c016cfe7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_t5_tacred_kongo_mlm_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_mlm_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_mlm_w_context_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_mlm_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_w_context_small_pipeline_en_5.4.2_3.0_1724662075306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_w_context_small_pipeline_en_5.4.2_3.0_1724662075306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_tacred_kongo_mlm_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_tacred_kongo_mlm_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_mlm_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-mlm-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_yans_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_yans_en.md new file mode 100644 index 00000000000000..7056ec3aa85fc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_yans_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_yans T5Transformer from shiontendon +author: John Snow Labs +name: flan_yans +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_yans` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_yans_en_5.4.2_3.0_1724663258374.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_yans_en_5.4.2_3.0_1724663258374.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_yans","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_yans", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_yans| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/Flan_Yans \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flan_yans_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flan_yans_pipeline_en.md new file mode 100644 index 00000000000000..be4a865386f9c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flan_yans_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_yans_pipeline pipeline T5Transformer from shiontendon +author: John Snow Labs +name: flan_yans_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_yans_pipeline` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_yans_pipeline_en_5.4.2_3.0_1724663311151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_yans_pipeline_en_5.4.2_3.0_1724663311151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_yans_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_yans_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_yans_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/Flan_Yans + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_en.md new file mode 100644 index 00000000000000..d1dbc7136c2111 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_japanese_english T5Transformer from meme1122 +author: John Snow Labs +name: flant5_japanese_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_japanese_english` is a English model originally trained by meme1122. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_japanese_english_en_5.4.2_3.0_1724671194905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_japanese_english_en_5.4.2_3.0_1724671194905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_japanese_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_japanese_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_japanese_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/meme1122/flant5-ja-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_pipeline_en.md new file mode 100644 index 00000000000000..d311481efcdb33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_japanese_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_japanese_english_pipeline pipeline T5Transformer from meme1122 +author: John Snow Labs +name: flant5_japanese_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_japanese_english_pipeline` is a English model originally trained by meme1122. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_japanese_english_pipeline_en_5.4.2_3.0_1724671243880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_japanese_english_pipeline_en_5.4.2_3.0_1724671243880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_japanese_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_japanese_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_japanese_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/meme1122/flant5-ja-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_pipeline_xx.md new file mode 100644 index 00000000000000..a04fa4ca5d96e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual flant5_offensive_multilingual_pipeline pipeline T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_multilingual_pipeline +date: 2024-08-26 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_multilingual_pipeline` is a Multilingual model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_multilingual_pipeline_xx_5.4.2_3.0_1724644436356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_multilingual_pipeline_xx_5.4.2_3.0_1724644436356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_offensive_multilingual_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_offensive_multilingual_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_multilingual_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/Flant5-offensive-multilingual + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_xx.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_xx.md new file mode 100644 index 00000000000000..d07825242468f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_offensive_multilingual_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual flant5_offensive_multilingual T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_multilingual +date: 2024-08-26 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_multilingual` is a Multilingual model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_multilingual_xx_5.4.2_3.0_1724644389674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_multilingual_xx_5.4.2_3.0_1724644389674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_offensive_multilingual","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_offensive_multilingual", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_multilingual| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/Flant5-offensive-multilingual \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_en.md new file mode 100644 index 00000000000000..a22024356acf5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_tuned_15_warmup T5Transformer from mixtralyanis +author: John Snow Labs +name: flant5_tuned_15_warmup +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_tuned_15_warmup` is a English model originally trained by mixtralyanis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_tuned_15_warmup_en_5.4.2_3.0_1724651751700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_tuned_15_warmup_en_5.4.2_3.0_1724651751700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_tuned_15_warmup","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_tuned_15_warmup", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_tuned_15_warmup| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/mixtralyanis/flant5-tuned-15-warmup \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_pipeline_en.md new file mode 100644 index 00000000000000..2f3d8d088f3d15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5_tuned_15_warmup_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_tuned_15_warmup_pipeline pipeline T5Transformer from mixtralyanis +author: John Snow Labs +name: flant5_tuned_15_warmup_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_tuned_15_warmup_pipeline` is a English model originally trained by mixtralyanis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_tuned_15_warmup_pipeline_en_5.4.2_3.0_1724651768071.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_tuned_15_warmup_pipeline_en_5.4.2_3.0_1724651768071.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_tuned_15_warmup_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_tuned_15_warmup_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_tuned_15_warmup_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/mixtralyanis/flant5-tuned-15-warmup + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_en.md new file mode 100644 index 00000000000000..b572cb6e43ee76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5base_instraction1500000_1epoch_16batch T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_instraction1500000_1epoch_16batch +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_instraction1500000_1epoch_16batch` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_1epoch_16batch_en_5.4.2_3.0_1724715066532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_1epoch_16batch_en_5.4.2_3.0_1724715066532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5base_instraction1500000_1epoch_16batch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5base_instraction1500000_1epoch_16batch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_instraction1500000_1epoch_16batch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_instraction1500000_1epoch_16batch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_pipeline_en.md new file mode 100644 index 00000000000000..eef3dda9e0a416 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-flant5base_instraction1500000_1epoch_16batch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5base_instraction1500000_1epoch_16batch_pipeline pipeline T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_instraction1500000_1epoch_16batch_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_instraction1500000_1epoch_16batch_pipeline` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_1epoch_16batch_pipeline_en_5.4.2_3.0_1724715118277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_1epoch_16batch_pipeline_en_5.4.2_3.0_1724715118277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5base_instraction1500000_1epoch_16batch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5base_instraction1500000_1epoch_16batch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_instraction1500000_1epoch_16batch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_instraction1500000_1epoch_16batch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_fr.md b/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_fr.md new file mode 100644 index 00000000000000..ff5659245f5ddd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French french_english_t5_small T5Transformer from Korventenn +author: John Snow Labs +name: french_english_t5_small +date: 2024-08-26 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_english_t5_small` is a French model originally trained by Korventenn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_english_t5_small_fr_5.4.2_3.0_1724641041472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_english_t5_small_fr_5.4.2_3.0_1724641041472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("french_english_t5_small","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("french_english_t5_small", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_english_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|247.2 MB| + +## References + +https://huggingface.co/Korventenn/fr_en-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_pipeline_fr.md new file mode 100644 index 00000000000000..af102e54f33930 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-french_english_t5_small_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French french_english_t5_small_pipeline pipeline T5Transformer from Korventenn +author: John Snow Labs +name: french_english_t5_small_pipeline +date: 2024-08-26 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_english_t5_small_pipeline` is a French model originally trained by Korventenn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_english_t5_small_pipeline_fr_5.4.2_3.0_1724641128710.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_english_t5_small_pipeline_fr_5.4.2_3.0_1724641128710.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("french_english_t5_small_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("french_english_t5_small_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_english_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|247.2 MB| + +## References + +https://huggingface.co/Korventenn/fr_en-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_de.md b/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_de.md new file mode 100644 index 00000000000000..c5a37da4af16cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_longt5_large T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large +date: 2024-08-26 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_de_5.4.2_3.0_1724653264110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_de_5.4.2_3.0_1724653264110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_longt5_large","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_longt5_large", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_pipeline_de.md new file mode 100644 index 00000000000000..12c6ce1ff72680 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-german_jeopardy_longt5_large_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_longt5_large_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large_pipeline +date: 2024-08-26 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_pipeline_de_5.4.2_3.0_1724653408025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_pipeline_de_5.4.2_3.0_1724653408025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_longt5_large_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_longt5_large_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_en.md b/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_en.md new file mode 100644 index 00000000000000..42205f8c85ed70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gramcorrection T5Transformer from AkshaySg +author: John Snow Labs +name: gramcorrection +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gramcorrection` is a English model originally trained by AkshaySg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gramcorrection_en_5.4.2_3.0_1724642769277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gramcorrection_en_5.4.2_3.0_1724642769277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gramcorrection","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gramcorrection", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gramcorrection| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AkshaySg/gramCorrection \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_pipeline_en.md new file mode 100644 index 00000000000000..430e69bfe4db1c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-gramcorrection_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gramcorrection_pipeline pipeline T5Transformer from AkshaySg +author: John Snow Labs +name: gramcorrection_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gramcorrection_pipeline` is a English model originally trained by AkshaySg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gramcorrection_pipeline_en_5.4.2_3.0_1724642816576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gramcorrection_pipeline_en_5.4.2_3.0_1724642816576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gramcorrection_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gramcorrection_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gramcorrection_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AkshaySg/gramCorrection + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_en.md b/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_en.md new file mode 100644 index 00000000000000..aeaa14b1600a7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammarcorrector_akashchauhan T5Transformer from akashchauhan +author: John Snow Labs +name: grammarcorrector_akashchauhan +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammarcorrector_akashchauhan` is a English model originally trained by akashchauhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammarcorrector_akashchauhan_en_5.4.2_3.0_1724687709738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammarcorrector_akashchauhan_en_5.4.2_3.0_1724687709738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammarcorrector_akashchauhan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammarcorrector_akashchauhan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammarcorrector_akashchauhan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.4 MB| + +## References + +https://huggingface.co/akashchauhan/GrammarCorrector \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_pipeline_en.md new file mode 100644 index 00000000000000..655af25cd5724e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-grammarcorrector_akashchauhan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammarcorrector_akashchauhan_pipeline pipeline T5Transformer from akashchauhan +author: John Snow Labs +name: grammarcorrector_akashchauhan_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammarcorrector_akashchauhan_pipeline` is a English model originally trained by akashchauhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammarcorrector_akashchauhan_pipeline_en_5.4.2_3.0_1724687762969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammarcorrector_akashchauhan_pipeline_en_5.4.2_3.0_1724687762969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammarcorrector_akashchauhan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammarcorrector_akashchauhan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammarcorrector_akashchauhan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.4 MB| + +## References + +https://huggingface.co/akashchauhan/GrammarCorrector + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_en.md b/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_en.md new file mode 100644 index 00000000000000..1b533fe68725ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English hindi_tonga_tonga_islands_english_translation T5Transformer from aakashyadav00 +author: John Snow Labs +name: hindi_tonga_tonga_islands_english_translation +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hindi_tonga_tonga_islands_english_translation` is a English model originally trained by aakashyadav00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hindi_tonga_tonga_islands_english_translation_en_5.4.2_3.0_1724672912611.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hindi_tonga_tonga_islands_english_translation_en_5.4.2_3.0_1724672912611.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("hindi_tonga_tonga_islands_english_translation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("hindi_tonga_tonga_islands_english_translation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hindi_tonga_tonga_islands_english_translation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.4 MB| + +## References + +https://huggingface.co/aakashyadav00/hindi_to_english_translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_pipeline_en.md new file mode 100644 index 00000000000000..45ce2ebb50cab7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-hindi_tonga_tonga_islands_english_translation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hindi_tonga_tonga_islands_english_translation_pipeline pipeline T5Transformer from aakashyadav00 +author: John Snow Labs +name: hindi_tonga_tonga_islands_english_translation_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hindi_tonga_tonga_islands_english_translation_pipeline` is a English model originally trained by aakashyadav00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hindi_tonga_tonga_islands_english_translation_pipeline_en_5.4.2_3.0_1724672934590.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hindi_tonga_tonga_islands_english_translation_pipeline_en_5.4.2_3.0_1724672934590.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hindi_tonga_tonga_islands_english_translation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hindi_tonga_tonga_islands_english_translation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hindi_tonga_tonga_islands_english_translation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.4 MB| + +## References + +https://huggingface.co/aakashyadav00/hindi_to_english_translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-hwt_en.md b/docs/_posts/ahmedlone127/2024-08-26-hwt_en.md new file mode 100644 index 00000000000000..926f8590baf424 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-hwt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English hwt T5Transformer from Rhasan97 +author: John Snow Labs +name: hwt +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hwt` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hwt_en_5.4.2_3.0_1724697013503.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hwt_en_5.4.2_3.0_1724697013503.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("hwt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("hwt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hwt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/Rhasan97/hwt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-hwt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-hwt_pipeline_en.md new file mode 100644 index 00000000000000..23c3d65c612023 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-hwt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hwt_pipeline pipeline T5Transformer from Rhasan97 +author: John Snow Labs +name: hwt_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hwt_pipeline` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hwt_pipeline_en_5.4.2_3.0_1724697032530.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hwt_pipeline_en_5.4.2_3.0_1724697032530.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hwt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hwt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hwt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/Rhasan97/hwt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_en.md b/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_en.md new file mode 100644 index 00000000000000..d5bfeb975a7fa0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English jenny_prod T5Transformer from metamyth +author: John Snow Labs +name: jenny_prod +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`jenny_prod` is a English model originally trained by metamyth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/jenny_prod_en_5.4.2_3.0_1724647052818.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/jenny_prod_en_5.4.2_3.0_1724647052818.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("jenny_prod","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("jenny_prod", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|jenny_prod| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/metamyth/jenny_prod \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_pipeline_en.md new file mode 100644 index 00000000000000..e610f026f68403 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-jenny_prod_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English jenny_prod_pipeline pipeline T5Transformer from metamyth +author: John Snow Labs +name: jenny_prod_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`jenny_prod_pipeline` is a English model originally trained by metamyth. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/jenny_prod_pipeline_en_5.4.2_3.0_1724647102747.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/jenny_prod_pipeline_en_5.4.2_3.0_1724647102747.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("jenny_prod_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("jenny_prod_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|jenny_prod_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/metamyth/jenny_prod + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_en.md new file mode 100644 index 00000000000000..32c00f4d5b5698 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English joint_task_instruct_absa_vietnamese_base T5Transformer from baohl00 +author: John Snow Labs +name: joint_task_instruct_absa_vietnamese_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_task_instruct_absa_vietnamese_base` is a English model originally trained by baohl00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_task_instruct_absa_vietnamese_base_en_5.4.2_3.0_1724651074780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_task_instruct_absa_vietnamese_base_en_5.4.2_3.0_1724651074780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("joint_task_instruct_absa_vietnamese_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("joint_task_instruct_absa_vietnamese_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_task_instruct_absa_vietnamese_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/baohl00/joint-task-instruct-absa-vi-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_pipeline_en.md new file mode 100644 index 00000000000000..c06a39076a2956 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-joint_task_instruct_absa_vietnamese_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English joint_task_instruct_absa_vietnamese_base_pipeline pipeline T5Transformer from baohl00 +author: John Snow Labs +name: joint_task_instruct_absa_vietnamese_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_task_instruct_absa_vietnamese_base_pipeline` is a English model originally trained by baohl00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_task_instruct_absa_vietnamese_base_pipeline_en_5.4.2_3.0_1724651124802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_task_instruct_absa_vietnamese_base_pipeline_en_5.4.2_3.0_1724651124802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("joint_task_instruct_absa_vietnamese_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("joint_task_instruct_absa_vietnamese_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_task_instruct_absa_vietnamese_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/baohl00/joint-task-instruct-absa-vi-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md b/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md new file mode 100644 index 00000000000000..cbb7ea075670e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en_5.4.2_3.0_1724672345881.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en_5.4.2_3.0_1724672345881.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|948.5 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-neg-neut-restaurants \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md new file mode 100644 index 00000000000000..c5b4346b755146 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en_5.4.2_3.0_1724672397061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en_5.4.2_3.0_1724672397061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|948.5 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-neg-neut-restaurants + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_en.md b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_en.md new file mode 100644 index 00000000000000..83fabcfde34e80 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_3_msrvtt T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_msrvtt +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_msrvtt` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_en_5.4.2_3.0_1724660831539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_en_5.4.2_3.0_1724660831539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_3_msrvtt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_3_msrvtt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_msrvtt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_msrvtt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_pipeline_en.md new file mode 100644 index 00000000000000..76b760bc716efb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_msrvtt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_3_msrvtt_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_msrvtt_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_msrvtt_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_pipeline_en_5.4.2_3.0_1724660852844.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_msrvtt_pipeline_en_5.4.2_3.0_1724660852844.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_3_msrvtt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_3_msrvtt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_msrvtt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_msrvtt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_en.md new file mode 100644 index 00000000000000..29121ba5b43c56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_3_two_words_msrvtt_lr_0_0001_sch_2 T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_two_words_msrvtt_lr_0_0001_sch_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_two_words_msrvtt_lr_0_0001_sch_2` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_sch_2_en_5.4.2_3.0_1724683105225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_sch_2_en_5.4.2_3.0_1724683105225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_3_two_words_msrvtt_lr_0_0001_sch_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_3_two_words_msrvtt_lr_0_0001_sch_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_two_words_msrvtt_lr_0_0001_sch_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|311.0 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_two_words_msrvtt_lr_0.0001_sch_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline_en.md new file mode 100644 index 00000000000000..df1d01b84ab64f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline_en_5.4.2_3.0_1724683131058.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline_en_5.4.2_3.0_1724683131058.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_two_words_msrvtt_lr_0_0001_sch_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|311.0 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_two_words_msrvtt_lr_0.0001_sch_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_en.md new file mode 100644 index 00000000000000..542427c91a05ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_ospal_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_ospal_v5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_ospal_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v5_en_5.4.2_3.0_1724700372928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v5_en_5.4.2_3.0_1724700372928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_ospal_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_ospal_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_ospal_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSPAL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_pipeline_en.md new file mode 100644 index 00000000000000..c66abe15a04595 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_ospal_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_ospal_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_ospal_v5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_ospal_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v5_pipeline_en_5.4.2_3.0_1724700551770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v5_pipeline_en_5.4.2_3.0_1724700551770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_ospal_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_ospal_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_ospal_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSPAL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_en.md new file mode 100644 index 00000000000000..6e870617a052cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_psoal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psoal_v3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psoal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v3_en_5.4.2_3.0_1724656105867.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v3_en_5.4.2_3.0_1724656105867.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psoal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSOAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_pipeline_en.md new file mode 100644 index 00000000000000..14ff7496b91521 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_psoal_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_psoal_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psoal_v3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psoal_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v3_pipeline_en_5.4.2_3.0_1724656277919.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v3_pipeline_en_5.4.2_3.0_1724656277919.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_psoal_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_psoal_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psoal_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSOAL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_soapl_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_soapl_v2_en.md new file mode 100644 index 00000000000000..fb84a6f292c575 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_soapl_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_soapl_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_soapl_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_soapl_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_v2_en_5.4.2_3.0_1724692743215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_v2_en_5.4.2_3.0_1724692743215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_soapl_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_soapl_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_soapl_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOAPL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_en.md new file mode 100644 index 00000000000000..59c79bf3b5da42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_posal T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_posal +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_posal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_en_5.4.2_3.0_1724655301796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_en_5.4.2_3.0_1724655301796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_posal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_posal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_posal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POSAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_pipeline_en.md new file mode 100644 index 00000000000000..3a5b1d7c5c63cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kltn_coqe_vit5_total_posal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_posal_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_posal_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_posal_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_pipeline_en_5.4.2_3.0_1724655473588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_pipeline_en_5.4.2_3.0_1724655473588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_posal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_posal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_posal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POSAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_en.md b/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_en.md new file mode 100644 index 00000000000000..0b24f0a81cdf0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kurdish_t5_base_finetuned_rudaw_kurdish T5Transformer from pedramyamini +author: John Snow Labs +name: kurdish_t5_base_finetuned_rudaw_kurdish +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kurdish_t5_base_finetuned_rudaw_kurdish` is a English model originally trained by pedramyamini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kurdish_t5_base_finetuned_rudaw_kurdish_en_5.4.2_3.0_1724712757197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kurdish_t5_base_finetuned_rudaw_kurdish_en_5.4.2_3.0_1724712757197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kurdish_t5_base_finetuned_rudaw_kurdish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kurdish_t5_base_finetuned_rudaw_kurdish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kurdish_t5_base_finetuned_rudaw_kurdish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pedramyamini/ku_t5_base-finetuned-rudaw-ku \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_pipeline_en.md new file mode 100644 index 00000000000000..c41702ca353da2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-kurdish_t5_base_finetuned_rudaw_kurdish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kurdish_t5_base_finetuned_rudaw_kurdish_pipeline pipeline T5Transformer from pedramyamini +author: John Snow Labs +name: kurdish_t5_base_finetuned_rudaw_kurdish_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kurdish_t5_base_finetuned_rudaw_kurdish_pipeline` is a English model originally trained by pedramyamini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kurdish_t5_base_finetuned_rudaw_kurdish_pipeline_en_5.4.2_3.0_1724712813635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kurdish_t5_base_finetuned_rudaw_kurdish_pipeline_en_5.4.2_3.0_1724712813635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kurdish_t5_base_finetuned_rudaw_kurdish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kurdish_t5_base_finetuned_rudaw_kurdish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kurdish_t5_base_finetuned_rudaw_kurdish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pedramyamini/ku_t5_base-finetuned-rudaw-ku + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_en.md b/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_en.md new file mode 100644 index 00000000000000..e237ce7a3cee98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lamini_flan_t5_248m_orca_12_5k T5Transformer from marcchew +author: John Snow Labs +name: lamini_flan_t5_248m_orca_12_5k +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lamini_flan_t5_248m_orca_12_5k` is a English model originally trained by marcchew. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_orca_12_5k_en_5.4.2_3.0_1724634213759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_orca_12_5k_en_5.4.2_3.0_1724634213759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lamini_flan_t5_248m_orca_12_5k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lamini_flan_t5_248m_orca_12_5k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lamini_flan_t5_248m_orca_12_5k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/marcchew/LaMini-Flan-T5-248M-Orca-12.5K \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_pipeline_en.md new file mode 100644 index 00000000000000..4671e8a4570372 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-lamini_flan_t5_248m_orca_12_5k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lamini_flan_t5_248m_orca_12_5k_pipeline pipeline T5Transformer from marcchew +author: John Snow Labs +name: lamini_flan_t5_248m_orca_12_5k_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lamini_flan_t5_248m_orca_12_5k_pipeline` is a English model originally trained by marcchew. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_orca_12_5k_pipeline_en_5.4.2_3.0_1724634261673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lamini_flan_t5_248m_orca_12_5k_pipeline_en_5.4.2_3.0_1724634261673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lamini_flan_t5_248m_orca_12_5k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lamini_flan_t5_248m_orca_12_5k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lamini_flan_t5_248m_orca_12_5k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/marcchew/LaMini-Flan-T5-248M-Orca-12.5K + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_en.md new file mode 100644 index 00000000000000..eacc1408f651bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_german +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_german_en_5.4.2_3.0_1724679478025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_german_en_5.4.2_3.0_1724679478025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_english_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_pipeline_en.md new file mode 100644 index 00000000000000..a78d0f0aa16dc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_english_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_english_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_english_german_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_english_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_german_pipeline_en_5.4.2_3.0_1724679555447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_english_german_pipeline_en_5.4.2_3.0_1724679555447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_english_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_english_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_english_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_en_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_en.md new file mode 100644 index 00000000000000..25a412d84d27ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_german_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_german_french +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_german_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_french_en_5.4.2_3.0_1724712808171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_french_en_5.4.2_3.0_1724712808171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_german_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_german_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_german_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_de_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_pipeline_en.md new file mode 100644 index 00000000000000..75b5b24264666f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_german_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_german_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_german_french_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_german_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_french_pipeline_en_5.4.2_3.0_1724712870628.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_german_french_pipeline_en_5.4.2_3.0_1724712870628.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_german_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_german_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_german_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_de_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_en.md new file mode 100644 index 00000000000000..a760c140cfa9c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_italian_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_italian_french +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_italian_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_french_en_5.4.2_3.0_1724695052868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_french_en_5.4.2_3.0_1724695052868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_italian_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_italian_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_italian_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_it_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_pipeline_en.md new file mode 100644 index 00000000000000..b763a8cac81e99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_italian_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_italian_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_italian_french_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_italian_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_french_pipeline_en_5.4.2_3.0_1724695114152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_french_pipeline_en_5.4.2_3.0_1724695114152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_italian_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_italian_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_italian_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_it_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_en.md new file mode 100644 index 00000000000000..3dba6a428b0ecf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_italian T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_italian +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_italian` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_italian_en_5.4.2_3.0_1724699304725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_italian_en_5.4.2_3.0_1724699304725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_pipeline_en.md new file mode 100644 index 00000000000000..2796a034701d19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_multitask_swedish_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_italian_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_italian_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_italian_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_italian_pipeline_en_5.4.2_3.0_1724699367333.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_italian_pipeline_en_5.4.2_3.0_1724699367333.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_swedish_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_swedish_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_en.md new file mode 100644 index 00000000000000..5a164b4600242b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_czech T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_czech +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_czech` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_czech_en_5.4.2_3.0_1724630709358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_czech_en_5.4.2_3.0_1724630709358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_czech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_czech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_czech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|175.9 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_cs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_pipeline_en.md new file mode 100644 index 00000000000000..17444a3cdc2bba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_czech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_czech_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_czech_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_czech_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_czech_pipeline_en_5.4.2_3.0_1724630769636.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_czech_pipeline_en_5.4.2_3.0_1724630769636.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_czech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_czech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_czech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|175.9 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_cs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_en.md new file mode 100644 index 00000000000000..169325cd82fa92 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_swedish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_swedish +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_swedish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_swedish_en_5.4.2_3.0_1724673970502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_swedish_en_5.4.2_3.0_1724673970502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_swedish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_swedish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_swedish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|176.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_sv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_pipeline_en.md new file mode 100644 index 00000000000000..a1648df65e505c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_summ_swedish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_swedish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_swedish_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_swedish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_swedish_pipeline_en_5.4.2_3.0_1724674030496.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_swedish_pipeline_en_5.4.2_3.0_1724674030496.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_swedish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_swedish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_swedish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|176.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_sv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_en.md new file mode 100644 index 00000000000000..af1d78e04b9207 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_english_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_german +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_german_en_5.4.2_3.0_1724641329799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_german_en_5.4.2_3.0_1724641329799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_english_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_english_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_pipeline_en.md new file mode 100644 index 00000000000000..db324fc604b0ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_english_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_english_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_german_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_german_pipeline_en_5.4.2_3.0_1724641390170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_german_pipeline_en_5.4.2_3.0_1724641390170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_english_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_english_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_en.md new file mode 100644 index 00000000000000..aac37f17418b44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_french_czech_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_czech_small_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_czech_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_czech_small_finetuned_en_5.4.2_3.0_1724676447928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_czech_small_finetuned_en_5.4.2_3.0_1724676447928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_french_czech_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_french_czech_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_czech_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_cs_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..b9621f0ea4dff2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_czech_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_french_czech_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_czech_small_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_czech_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_czech_small_finetuned_pipeline_en_5.4.2_3.0_1724676508051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_czech_small_finetuned_pipeline_en_5.4.2_3.0_1724676508051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_french_czech_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_french_czech_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_czech_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_cs_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_en.md new file mode 100644 index 00000000000000..9c0b5541986198 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_french_german_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_german_small_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_german_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_small_finetuned_en_5.4.2_3.0_1724715495875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_small_finetuned_en_5.4.2_3.0_1724715495875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_french_german_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_french_german_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_german_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_de_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..3bb091dfd38588 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_french_german_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_french_german_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_german_small_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_german_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_small_finetuned_pipeline_en_5.4.2_3.0_1724715557619.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_small_finetuned_pipeline_en_5.4.2_3.0_1724715557619.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_french_german_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_french_german_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_german_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_de_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_en.md new file mode 100644 index 00000000000000..239357b9d01419 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_german_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_en_5.4.2_3.0_1724675086945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_en_5.4.2_3.0_1724675086945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_german_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_german_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_pipeline_en.md new file mode 100644 index 00000000000000..47910a4bd78b96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_german_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_pipeline_en_5.4.2_3.0_1724675147180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_pipeline_en_5.4.2_3.0_1724675147180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_german_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_german_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_en.md new file mode 100644 index 00000000000000..34523981f63b1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_german_swedish_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_swedish_small_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_swedish_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_swedish_small_finetuned_en_5.4.2_3.0_1724671276469.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_swedish_small_finetuned_en_5.4.2_3.0_1724671276469.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_german_swedish_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_german_swedish_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_swedish_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_sv_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..6e3df59ee2501b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_german_swedish_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_german_swedish_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_swedish_small_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_swedish_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_swedish_small_finetuned_pipeline_en_5.4.2_3.0_1724671338120.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_swedish_small_finetuned_pipeline_en_5.4.2_3.0_1724671338120.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_german_swedish_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_german_swedish_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_swedish_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_sv_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_en.md new file mode 100644 index 00000000000000..e03d863847b66f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_spanish +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_spanish_en_5.4.2_3.0_1724663587263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_spanish_en_5.4.2_3.0_1724663587263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_pipeline_en.md new file mode 100644 index 00000000000000..b8636a1c6dfd32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_italian_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_spanish_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_spanish_pipeline_en_5.4.2_3.0_1724663647193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_spanish_pipeline_en_5.4.2_3.0_1724663647193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_italian_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_italian_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_en.md new file mode 100644 index 00000000000000..35485819a472b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_en_5.4.2_3.0_1724709963235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_en_5.4.2_3.0_1724709963235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_pipeline_en.md new file mode 100644 index 00000000000000..61cbd562568640 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_pipeline_en_5.4.2_3.0_1724710024191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_pipeline_en_5.4.2_3.0_1724710024191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_spanish_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_spanish_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_en.md new file mode 100644 index 00000000000000..ea2b7b7426d7da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_english_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_english_small_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_english_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_small_finetuned_en_5.4.2_3.0_1724637168040.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_small_finetuned_en_5.4.2_3.0_1724637168040.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_english_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_english_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_english_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_en_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..1d926cfe6f8dc7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_spanish_english_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_english_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_english_small_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_english_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_small_finetuned_pipeline_en_5.4.2_3.0_1724637229051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_english_small_finetuned_pipeline_en_5.4.2_3.0_1724637229051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_spanish_english_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_spanish_english_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_english_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_en_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_en.md new file mode 100644 index 00000000000000..bb2707c1972230 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_german +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_german_en_5.4.2_3.0_1724638798528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_german_en_5.4.2_3.0_1724638798528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_pipeline_en.md new file mode 100644 index 00000000000000..94cbf653d70123 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-legal_t5_small_trans_swedish_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_german_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_german_pipeline_en_5.4.2_3.0_1724638858724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_german_pipeline_en_5.4.2_3.0_1724638858724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_swedish_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_swedish_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_en.md new file mode 100644 index 00000000000000..5836260aee92c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_local_base_finetuned_xsum T5Transformer from saekomdalkom +author: John Snow Labs +name: long_t5_local_base_finetuned_xsum +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_finetuned_xsum` is a English model originally trained by saekomdalkom. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_finetuned_xsum_en_5.4.2_3.0_1724679288610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_finetuned_xsum_en_5.4.2_3.0_1724679288610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_local_base_finetuned_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_local_base_finetuned_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_finetuned_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/saekomdalkom/long-t5-local-base-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_pipeline_en.md new file mode 100644 index 00000000000000..aed9e2df36daa6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_finetuned_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_local_base_finetuned_xsum_pipeline pipeline T5Transformer from saekomdalkom +author: John Snow Labs +name: long_t5_local_base_finetuned_xsum_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_finetuned_xsum_pipeline` is a English model originally trained by saekomdalkom. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_finetuned_xsum_pipeline_en_5.4.2_3.0_1724679340771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_finetuned_xsum_pipeline_en_5.4.2_3.0_1724679340771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_local_base_finetuned_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_local_base_finetuned_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_finetuned_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/saekomdalkom/long-t5-local-base-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_en.md new file mode 100644 index 00000000000000..201233c39461c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_local_base_ilc T5Transformer from AathifMohammed +author: John Snow Labs +name: long_t5_local_base_ilc +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_ilc` is a English model originally trained by AathifMohammed. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_ilc_en_5.4.2_3.0_1724708919865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_ilc_en_5.4.2_3.0_1724708919865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_local_base_ilc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_local_base_ilc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_ilc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AathifMohammed/long-t5-local-base-ILC \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_pipeline_en.md new file mode 100644 index 00000000000000..d025d37a554d52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_local_base_ilc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_local_base_ilc_pipeline pipeline T5Transformer from AathifMohammed +author: John Snow Labs +name: long_t5_local_base_ilc_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_ilc_pipeline` is a English model originally trained by AathifMohammed. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_ilc_pipeline_en_5.4.2_3.0_1724708969785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_ilc_pipeline_en_5.4.2_3.0_1724708969785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_local_base_ilc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_local_base_ilc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_ilc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AathifMohammed/long-t5-local-base-ILC + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_en.md new file mode 100644 index 00000000000000..d0b6c334c7432e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_tglobal_base_biolaysum_elife_baseline T5Transformer from domenicrosati +author: John Snow Labs +name: long_t5_tglobal_base_biolaysum_elife_baseline +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_tglobal_base_biolaysum_elife_baseline` is a English model originally trained by domenicrosati. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_base_biolaysum_elife_baseline_en_5.4.2_3.0_1724650697142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_base_biolaysum_elife_baseline_en_5.4.2_3.0_1724650697142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_tglobal_base_biolaysum_elife_baseline","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_tglobal_base_biolaysum_elife_baseline", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_tglobal_base_biolaysum_elife_baseline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/domenicrosati/long-t5-tglobal-base-biolaysum-elife-baseline \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_pipeline_en.md new file mode 100644 index 00000000000000..dedfdaae01c71c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-long_t5_tglobal_base_biolaysum_elife_baseline_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_tglobal_base_biolaysum_elife_baseline_pipeline pipeline T5Transformer from domenicrosati +author: John Snow Labs +name: long_t5_tglobal_base_biolaysum_elife_baseline_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_tglobal_base_biolaysum_elife_baseline_pipeline` is a English model originally trained by domenicrosati. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_base_biolaysum_elife_baseline_pipeline_en_5.4.2_3.0_1724650744877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_base_biolaysum_elife_baseline_pipeline_en_5.4.2_3.0_1724650744877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_tglobal_base_biolaysum_elife_baseline_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_tglobal_base_biolaysum_elife_baseline_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_tglobal_base_biolaysum_elife_baseline_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/domenicrosati/long-t5-tglobal-base-biolaysum-elife-baseline + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-longtao_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-longtao_v1_en.md new file mode 100644 index 00000000000000..d8915a9fda6fd3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-longtao_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English longtao_v1 T5Transformer from eustance +author: John Snow Labs +name: longtao_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`longtao_v1` is a English model originally trained by eustance. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/longtao_v1_en_5.4.2_3.0_1724710931050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/longtao_v1_en_5.4.2_3.0_1724710931050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("longtao_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("longtao_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|longtao_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/eustance/longtao-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_en.md b/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_en.md new file mode 100644 index 00000000000000..952b3b6bd55121 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English maxmini_instruct_248m T5Transformer from suriya7 +author: John Snow Labs +name: maxmini_instruct_248m +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maxmini_instruct_248m` is a English model originally trained by suriya7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maxmini_instruct_248m_en_5.4.2_3.0_1724636513934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maxmini_instruct_248m_en_5.4.2_3.0_1724636513934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("maxmini_instruct_248m","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("maxmini_instruct_248m", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maxmini_instruct_248m| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/suriya7/MaxMini-Instruct-248M \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_pipeline_en.md new file mode 100644 index 00000000000000..47fcd9808b56b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-maxmini_instruct_248m_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English maxmini_instruct_248m_pipeline pipeline T5Transformer from suriya7 +author: John Snow Labs +name: maxmini_instruct_248m_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maxmini_instruct_248m_pipeline` is a English model originally trained by suriya7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maxmini_instruct_248m_pipeline_en_5.4.2_3.0_1724636562808.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maxmini_instruct_248m_pipeline_en_5.4.2_3.0_1724636562808.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("maxmini_instruct_248m_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("maxmini_instruct_248m_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maxmini_instruct_248m_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/suriya7/MaxMini-Instruct-248M + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_en.md b/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_en.md new file mode 100644 index 00000000000000..f457da4f37b029 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mednotesummarization T5Transformer from kswanjitsu +author: John Snow Labs +name: mednotesummarization +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mednotesummarization` is a English model originally trained by kswanjitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mednotesummarization_en_5.4.2_3.0_1724701280909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mednotesummarization_en_5.4.2_3.0_1724701280909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mednotesummarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mednotesummarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mednotesummarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kswanjitsu/MedNoteSummarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_pipeline_en.md new file mode 100644 index 00000000000000..1e489c34927070 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mednotesummarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mednotesummarization_pipeline pipeline T5Transformer from kswanjitsu +author: John Snow Labs +name: mednotesummarization_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mednotesummarization_pipeline` is a English model originally trained by kswanjitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mednotesummarization_pipeline_en_5.4.2_3.0_1724701424817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mednotesummarization_pipeline_en_5.4.2_3.0_1724701424817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mednotesummarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mednotesummarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mednotesummarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kswanjitsu/MedNoteSummarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_en.md b/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_en.md new file mode 100644 index 00000000000000..8d73ebfea230fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mleafit_es2ptmt5 T5Transformer from jdmartinev +author: John Snow Labs +name: mleafit_es2ptmt5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mleafit_es2ptmt5` is a English model originally trained by jdmartinev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mleafit_es2ptmt5_en_5.4.2_3.0_1724702281693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mleafit_es2ptmt5_en_5.4.2_3.0_1724702281693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mleafit_es2ptmt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mleafit_es2ptmt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mleafit_es2ptmt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.4 MB| + +## References + +https://huggingface.co/jdmartinev/MLEAFIT_es2ptmT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_pipeline_en.md new file mode 100644 index 00000000000000..307aab30f862d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mleafit_es2ptmt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mleafit_es2ptmt5_pipeline pipeline T5Transformer from jdmartinev +author: John Snow Labs +name: mleafit_es2ptmt5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mleafit_es2ptmt5_pipeline` is a English model originally trained by jdmartinev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mleafit_es2ptmt5_pipeline_en_5.4.2_3.0_1724702302311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mleafit_es2ptmt5_pipeline_en_5.4.2_3.0_1724702302311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mleafit_es2ptmt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mleafit_es2ptmt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mleafit_es2ptmt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.4 MB| + +## References + +https://huggingface.co/jdmartinev/MLEAFIT_es2ptmT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mnli_en.md b/docs/_posts/ahmedlone127/2024-08-26-mnli_en.md new file mode 100644 index 00000000000000..da64578249781f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mnli_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mnli T5Transformer from ShengdingHu +author: John Snow Labs +name: mnli +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_en_5.4.2_3.0_1724664715295.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_en_5.4.2_3.0_1724664715295.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mnli","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mnli", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/mnli \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mnli_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mnli_pipeline_en.md new file mode 100644 index 00000000000000..1c45a40277e450 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mnli_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mnli_pipeline pipeline T5Transformer from ShengdingHu +author: John Snow Labs +name: mnli_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_pipeline` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_pipeline_en_5.4.2_3.0_1724664763669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_pipeline_en_5.4.2_3.0_1724664763669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mnli_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mnli_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/mnli + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_en.md new file mode 100644 index 00000000000000..8bf9141de62cbf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mnli_t5_small_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_small_seed_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_small_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_small_seed_3_en_5.4.2_3.0_1724711262144.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_small_seed_3_en_5.4.2_3.0_1724711262144.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mnli_t5_small_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mnli_t5_small_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_small_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.5 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-small_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..3c25fa8a00e347 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mnli_t5_small_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mnli_t5_small_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_small_seed_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_small_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724711282745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724711282745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mnli_t5_small_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mnli_t5_small_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_small_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.5 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-small_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_en.md b/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_en.md new file mode 100644 index 00000000000000..6226a2fdc74ac0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English modelo_wikilingua_3epoch T5Transformer from godoyj +author: John Snow Labs +name: modelo_wikilingua_3epoch +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`modelo_wikilingua_3epoch` is a English model originally trained by godoyj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/modelo_wikilingua_3epoch_en_5.4.2_3.0_1724704576378.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/modelo_wikilingua_3epoch_en_5.4.2_3.0_1724704576378.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("modelo_wikilingua_3epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("modelo_wikilingua_3epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|modelo_wikilingua_3epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/godoyj/modelo-wikilingua-3epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_pipeline_en.md new file mode 100644 index 00000000000000..cb822a84c72302 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-modelo_wikilingua_3epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English modelo_wikilingua_3epoch_pipeline pipeline T5Transformer from godoyj +author: John Snow Labs +name: modelo_wikilingua_3epoch_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`modelo_wikilingua_3epoch_pipeline` is a English model originally trained by godoyj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/modelo_wikilingua_3epoch_pipeline_en_5.4.2_3.0_1724704641457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/modelo_wikilingua_3epoch_pipeline_en_5.4.2_3.0_1724704641457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("modelo_wikilingua_3epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("modelo_wikilingua_3epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|modelo_wikilingua_3epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/godoyj/modelo-wikilingua-3epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_en.md b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_en.md new file mode 100644 index 00000000000000..aa2f4c66852571 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_base_fine_tune T5Transformer from Phudish +author: John Snow Labs +name: molt5_base_fine_tune +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_fine_tune` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_fine_tune_en_5.4.2_3.0_1724699942393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_fine_tune_en_5.4.2_3.0_1724699942393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_base_fine_tune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_base_fine_tune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_fine_tune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Phudish/molt5-base-fine-tune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_pipeline_en.md new file mode 100644 index 00000000000000..14e578d5a8f20c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_fine_tune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_base_fine_tune_pipeline pipeline T5Transformer from Phudish +author: John Snow Labs +name: molt5_base_fine_tune_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_fine_tune_pipeline` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_fine_tune_pipeline_en_5.4.2_3.0_1724699994699.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_fine_tune_pipeline_en_5.4.2_3.0_1724699994699.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_base_fine_tune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_base_fine_tune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_fine_tune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Phudish/molt5-base-fine-tune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_en.md b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_en.md new file mode 100644 index 00000000000000..2eeeae7998d9e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_base_smiles2caption T5Transformer from laituan245 +author: John Snow Labs +name: molt5_base_smiles2caption +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_smiles2caption` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_smiles2caption_en_5.4.2_3.0_1724631841742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_smiles2caption_en_5.4.2_3.0_1724631841742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_base_smiles2caption","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_base_smiles2caption", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_smiles2caption| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laituan245/molt5-base-smiles2caption \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_pipeline_en.md new file mode 100644 index 00000000000000..896e3571042658 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-molt5_base_smiles2caption_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_base_smiles2caption_pipeline pipeline T5Transformer from laituan245 +author: John Snow Labs +name: molt5_base_smiles2caption_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_smiles2caption_pipeline` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_smiles2caption_pipeline_en_5.4.2_3.0_1724631922880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_smiles2caption_pipeline_en_5.4.2_3.0_1724631922880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_base_smiles2caption_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_base_smiles2caption_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_smiles2caption_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laituan245/molt5-base-smiles2caption + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-monoqa_en.md b/docs/_posts/ahmedlone127/2024-08-26-monoqa_en.md new file mode 100644 index 00000000000000..b80cbd03feb147 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-monoqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English monoqa T5Transformer from 9meo +author: John Snow Labs +name: monoqa +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`monoqa` is a English model originally trained by 9meo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/monoqa_en_5.4.2_3.0_1724644916012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/monoqa_en_5.4.2_3.0_1724644916012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("monoqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("monoqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|monoqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/9meo/monoQA \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-monoqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-monoqa_pipeline_en.md new file mode 100644 index 00000000000000..148a7d6704e7f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-monoqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English monoqa_pipeline pipeline T5Transformer from 9meo +author: John Snow Labs +name: monoqa_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`monoqa_pipeline` is a English model originally trained by 9meo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/monoqa_pipeline_en_5.4.2_3.0_1724644964079.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/monoqa_pipeline_en_5.4.2_3.0_1724644964079.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("monoqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("monoqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|monoqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/9meo/monoQA + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_hu.md b/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_hu.md new file mode 100644 index 00000000000000..f4c5f619e86e57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_hu.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Hungarian morphological_generator_ud_mt5_hungarian T5Transformer from NYTK +author: John Snow Labs +name: morphological_generator_ud_mt5_hungarian +date: 2024-08-26 +tags: [hu, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: hu +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`morphological_generator_ud_mt5_hungarian` is a Hungarian model originally trained by NYTK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/morphological_generator_ud_mt5_hungarian_hu_5.4.2_3.0_1724676942350.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/morphological_generator_ud_mt5_hungarian_hu_5.4.2_3.0_1724676942350.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("morphological_generator_ud_mt5_hungarian","hu") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("morphological_generator_ud_mt5_hungarian", "hu") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|morphological_generator_ud_mt5_hungarian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|hu| +|Size:|2.6 GB| + +## References + +https://huggingface.co/NYTK/morphological-generator-ud-mt5-hungarian \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_pipeline_hu.md b/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_pipeline_hu.md new file mode 100644 index 00000000000000..24e8a75b936a14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-morphological_generator_ud_mt5_hungarian_pipeline_hu.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Hungarian morphological_generator_ud_mt5_hungarian_pipeline pipeline T5Transformer from NYTK +author: John Snow Labs +name: morphological_generator_ud_mt5_hungarian_pipeline +date: 2024-08-26 +tags: [hu, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: hu +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`morphological_generator_ud_mt5_hungarian_pipeline` is a Hungarian model originally trained by NYTK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/morphological_generator_ud_mt5_hungarian_pipeline_hu_5.4.2_3.0_1724677151651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/morphological_generator_ud_mt5_hungarian_pipeline_hu_5.4.2_3.0_1724677151651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("morphological_generator_ud_mt5_hungarian_pipeline", lang = "hu") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("morphological_generator_ud_mt5_hungarian_pipeline", lang = "hu") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|morphological_generator_ud_mt5_hungarian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|hu| +|Size:|2.6 GB| + +## References + +https://huggingface.co/NYTK/morphological-generator-ud-mt5-hungarian + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_en.md new file mode 100644 index 00000000000000..352315c8395558 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mrpc_t5_small_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_small_seed_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_small_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_2_en_5.4.2_3.0_1724686574277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_2_en_5.4.2_3.0_1724686574277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mrpc_t5_small_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mrpc_t5_small_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_small_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.4 MB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-small_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..a7de3fb773ab8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mrpc_t5_small_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_small_seed_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_small_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724686602788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724686602788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mrpc_t5_small_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mrpc_t5_small_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_small_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.4 MB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-small_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_en.md new file mode 100644 index 00000000000000..4cd227266a05f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mrpc_t5_small_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_small_seed_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_small_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_3_en_5.4.2_3.0_1724688464610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_3_en_5.4.2_3.0_1724688464610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mrpc_t5_small_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mrpc_t5_small_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_small_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.4 MB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-small_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..bf808f4dc772f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mrpc_t5_small_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mrpc_t5_small_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_small_seed_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_small_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724688493314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724688493314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mrpc_t5_small_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mrpc_t5_small_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_small_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.4 MB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-small_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_ar.md b/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_ar.md new file mode 100644 index 00000000000000..278f285334b4b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_ar.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Arabic msmarco_arabic_mt5_base_v1 T5Transformer from doc2query +author: John Snow Labs +name: msmarco_arabic_mt5_base_v1 +date: 2024-08-26 +tags: [ar, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ar +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_arabic_mt5_base_v1` is a Arabic model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_arabic_mt5_base_v1_ar_5.4.2_3.0_1724634484488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_arabic_mt5_base_v1_ar_5.4.2_3.0_1724634484488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msmarco_arabic_mt5_base_v1","ar") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msmarco_arabic_mt5_base_v1", "ar") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_arabic_mt5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ar| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-arabic-mt5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_pipeline_ar.md b/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_pipeline_ar.md new file mode 100644 index 00000000000000..51b7c00c725140 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-msmarco_arabic_mt5_base_v1_pipeline_ar.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Arabic msmarco_arabic_mt5_base_v1_pipeline pipeline T5Transformer from doc2query +author: John Snow Labs +name: msmarco_arabic_mt5_base_v1_pipeline +date: 2024-08-26 +tags: [ar, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ar +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_arabic_mt5_base_v1_pipeline` is a Arabic model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_arabic_mt5_base_v1_pipeline_ar_5.4.2_3.0_1724634745759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_arabic_mt5_base_v1_pipeline_ar_5.4.2_3.0_1724634745759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("msmarco_arabic_mt5_base_v1_pipeline", lang = "ar") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("msmarco_arabic_mt5_base_v1_pipeline", lang = "ar") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_arabic_mt5_base_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ar| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-arabic-mt5-base-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-msmarco_french_mt5_base_v1_fr.md b/docs/_posts/ahmedlone127/2024-08-26-msmarco_french_mt5_base_v1_fr.md new file mode 100644 index 00000000000000..877ddf36a4d0d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-msmarco_french_mt5_base_v1_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French msmarco_french_mt5_base_v1 T5Transformer from doc2query +author: John Snow Labs +name: msmarco_french_mt5_base_v1 +date: 2024-08-26 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_french_mt5_base_v1` is a French model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_french_mt5_base_v1_fr_5.4.2_3.0_1724649224514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_french_mt5_base_v1_fr_5.4.2_3.0_1724649224514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msmarco_french_mt5_base_v1","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msmarco_french_mt5_base_v1", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_french_mt5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-french-mt5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_aym_lex_try_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_aym_lex_try_en.md new file mode 100644 index 00000000000000..cdd1d9dff615a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_aym_lex_try_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_aym_lex_try T5Transformer from alvations +author: John Snow Labs +name: mt5_aym_lex_try +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_aym_lex_try` is a English model originally trained by alvations. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try_en_5.4.2_3.0_1724682045465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_aym_lex_try_en_5.4.2_3.0_1724682045465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_aym_lex_try","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_aym_lex_try", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_aym_lex_try| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/alvations/mt5-aym-lex-try \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_dequad_qg_ae_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_dequad_qg_ae_pipeline_de.md new file mode 100644 index 00000000000000..b5579cd0a50d7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_dequad_qg_ae_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German mt5_base_dequad_qg_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_dequad_qg_ae_pipeline +date: 2024-08-26 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qg_ae_pipeline` is a German model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_ae_pipeline_de_5.4.2_3.0_1724682337793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_ae_pipeline_de_5.4.2_3.0_1724682337793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_dequad_qg_ae_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_dequad_qg_ae_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qg_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|2.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-dequad-qg-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_es.md new file mode 100644 index 00000000000000..fdc48a21de9035 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_esquad_qg T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qg +date: 2024-08-26 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg` is a Castilian, Spanish model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_es_5.4.2_3.0_1724665898283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_es_5.4.2_3.0_1724665898283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qg","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qg", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_pipeline_es.md new file mode 100644 index 00000000000000..76c8e90b64297c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_esquad_qg_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_esquad_qg_pipeline +date: 2024-08-26 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_pipeline` is a Castilian, Spanish model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_pipeline_es_5.4.2_3.0_1724666046209.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_pipeline_es_5.4.2_3.0_1724666046209.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qg_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qg_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-esquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_en.md new file mode 100644 index 00000000000000..784886af45baee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_15000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_15000_en_5.4.2_3.0_1724657149906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_15000_en_5.4.2_3.0_1724657149906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|871.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_pipeline_en.md new file mode 100644 index 00000000000000..aab18b7dcec0cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_esquad_qg_trimmed_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_15000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724657193090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724657193090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qg_trimmed_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qg_trimmed_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|871.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_en.md new file mode 100644 index 00000000000000..ccfbb9634feed6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_fce_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_fce_e8_b16 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_fce_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_fce_e8_b16_en_5.4.2_3.0_1724657680744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_fce_e8_b16_en_5.4.2_3.0_1724657680744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_fce_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_fce_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_fce_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-fce-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..0b9bd62cf4483b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_fce_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_fce_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_fce_e8_b16_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_fce_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_fce_e8_b16_pipeline_en_5.4.2_3.0_1724657992127.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_fce_e8_b16_pipeline_en_5.4.2_3.0_1724657992127.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_fce_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_fce_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_fce_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-fce-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_mt5_summarization_task_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_mt5_summarization_task_en.md new file mode 100644 index 00000000000000..49948247101b78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_mt5_summarization_task_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_mt5_summarization_task T5Transformer from shahadalll +author: John Snow Labs +name: mt5_base_finetuned_mt5_summarization_task +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_mt5_summarization_task` is a English model originally trained by shahadalll. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_mt5_summarization_task_en_5.4.2_3.0_1724684220761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_mt5_summarization_task_en_5.4.2_3.0_1724684220761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_mt5_summarization_task","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_mt5_summarization_task", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_mt5_summarization_task| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/shahadalll/mt5-base-finetuned-mt5-summarization-task \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_en.md new file mode 100644 index 00000000000000..9ef4794eff04eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1 T5Transformer from quickman +author: John Snow Labs +name: mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1` is a English model originally trained by quickman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_en_5.4.2_3.0_1724690942684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_en_5.4.2_3.0_1724690942684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/quickman/mt5-base-finetuned-novel-chinese-to-spanish-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline_en.md new file mode 100644 index 00000000000000..301e1e6bd16ee4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline pipeline T5Transformer from quickman +author: John Snow Labs +name: mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline` is a English model originally trained by quickman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline_en_5.4.2_3.0_1724691177793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline_en_5.4.2_3.0_1724691177793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_novel_chinese_tonga_tonga_islands_spanish_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/quickman/mt5-base-finetuned-novel-chinese-to-spanish-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_en.md new file mode 100644 index 00000000000000..cd400a3d275a55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_qg T5Transformer from parinzee +author: John Snow Labs +name: mt5_base_finetuned_qg +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_qg` is a English model originally trained by parinzee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_qg_en_5.4.2_3.0_1724701418866.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_qg_en_5.4.2_3.0_1724701418866.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/parinzee/mt5-base-finetuned-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_pipeline_en.md new file mode 100644 index 00000000000000..280be003a70764 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_qg_pipeline pipeline T5Transformer from parinzee +author: John Snow Labs +name: mt5_base_finetuned_qg_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_qg_pipeline` is a English model originally trained by parinzee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_qg_pipeline_en_5.4.2_3.0_1724701584240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_qg_pipeline_en_5.4.2_3.0_1724701584240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/parinzee/mt5-base-finetuned-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_en.md new file mode 100644 index 00000000000000..4b0e5be9434d07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2 T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_en_5.4.2_3.0_1724695776433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_en_5.4.2_3.0_1724695776433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-RAW_data_prep_2021_12_26___t22027_162754.csv__g_mt5_base_L2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline_en.md new file mode 100644 index 00000000000000..b364fe04feae53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline pipeline T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline_en_5.4.2_3.0_1724696261375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline_en_5.4.2_3.0_1724696261375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-RAW_data_prep_2021_12_26___t22027_162754.csv__g_mt5_base_L2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5_en.md new file mode 100644 index 00000000000000..405190b0bd479c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5 T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5_en_5.4.2_3.0_1724660022564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5_en_5.4.2_3.0_1724660022564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t22027_162754_csv__g_mt5_base_l5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-RAW_data_prep_2021_12_26___t22027_162754.csv__g_mt5_base_L5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_en.md new file mode 100644 index 00000000000000..d98a778c0be5d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_en_5.4.2_3.0_1724701058354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_en_5.4.2_3.0_1724701058354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_pipeline_en.md new file mode 100644 index 00000000000000..f405f4ed6fede5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_germeval21_toxic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_pipeline_en_5.4.2_3.0_1724701243324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_pipeline_en_5.4.2_3.0_1724701243324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_germeval21_toxic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_germeval21_toxic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_en.md new file mode 100644 index 00000000000000..81e6300d1ae17c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_koquad_qg_trimmed T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_koquad_qg_trimmed +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_koquad_qg_trimmed` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qg_trimmed_en_5.4.2_3.0_1724644582215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qg_trimmed_en_5.4.2_3.0_1724644582215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_koquad_qg_trimmed","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_koquad_qg_trimmed", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_koquad_qg_trimmed| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-koquad-qg-trimmed \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_pipeline_en.md new file mode 100644 index 00000000000000..8bad5894f40cac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_koquad_qg_trimmed_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_koquad_qg_trimmed_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_koquad_qg_trimmed_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_koquad_qg_trimmed_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qg_trimmed_pipeline_en_5.4.2_3.0_1724644660833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_koquad_qg_trimmed_pipeline_en_5.4.2_3.0_1724644660833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_koquad_qg_trimmed_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_koquad_qg_trimmed_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_koquad_qg_trimmed_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-koquad-qg-trimmed + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_en.md new file mode 100644 index 00000000000000..edca17c3b1bc01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_50k_ruen T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_50k_ruen +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_50k_ruen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ruen_en_5.4.2_3.0_1724715394755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ruen_en_5.4.2_3.0_1724715394755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_50k_ruen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_50k_ruen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_50k_ruen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-50k-ruen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_pipeline_en.md new file mode 100644 index 00000000000000..35c158024524f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_nc16_50k_ruen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_50k_ruen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_50k_ruen_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_50k_ruen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ruen_pipeline_en_5.4.2_3.0_1724715683080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_50k_ruen_pipeline_en_5.4.2_3.0_1724715683080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_50k_ruen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_50k_ruen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_50k_ruen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-50k-ruen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_pipeline_xx.md new file mode 100644 index 00000000000000..8c878868a48bdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual mt5_base_qgen_pipeline pipeline T5Transformer from nbroad +author: John Snow Labs +name: mt5_base_qgen_pipeline +date: 2024-08-26 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_qgen_pipeline` is a Multilingual model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_qgen_pipeline_xx_5.4.2_3.0_1724635042104.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_qgen_pipeline_xx_5.4.2_3.0_1724635042104.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_qgen_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_qgen_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_qgen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|2.6 GB| + +## References + +https://huggingface.co/nbroad/mt5-base-qgen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_xx.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_xx.md new file mode 100644 index 00000000000000..47bb895d58c514 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_qgen_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual mt5_base_qgen T5Transformer from nbroad +author: John Snow Labs +name: mt5_base_qgen +date: 2024-08-26 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_qgen` is a Multilingual model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_qgen_xx_5.4.2_3.0_1724634860878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_qgen_xx_5.4.2_3.0_1724634860878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_qgen","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_qgen", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_qgen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|2.6 GB| + +## References + +https://huggingface.co/nbroad/mt5-base-qgen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_it.md new file mode 100644 index 00000000000000..d956e8269ca5d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_base_repubblica_tonga_tonga_islands_ilgiornale T5Transformer from gsarti +author: John Snow Labs +name: mt5_base_repubblica_tonga_tonga_islands_ilgiornale +date: 2024-08-26 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_repubblica_tonga_tonga_islands_ilgiornale` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_repubblica_tonga_tonga_islands_ilgiornale_it_5.4.2_3.0_1724681548056.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_repubblica_tonga_tonga_islands_ilgiornale_it_5.4.2_3.0_1724681548056.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_repubblica_tonga_tonga_islands_ilgiornale","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_repubblica_tonga_tonga_islands_ilgiornale", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_repubblica_tonga_tonga_islands_ilgiornale| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|2.4 GB| + +## References + +https://huggingface.co/gsarti/mt5-base-repubblica-to-ilgiornale \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline_it.md new file mode 100644 index 00000000000000..ef8878e3d6e511 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline pipeline T5Transformer from gsarti +author: John Snow Labs +name: mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline +date: 2024-08-26 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline_it_5.4.2_3.0_1724681822519.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline_it_5.4.2_3.0_1724681822519.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_repubblica_tonga_tonga_islands_ilgiornale_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|2.4 GB| + +## References + +https://huggingface.co/gsarti/mt5-base-repubblica-to-ilgiornale + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_en.md new file mode 100644 index 00000000000000..06023619a8960d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_slovak_news T5Transformer from kiviki +author: John Snow Labs +name: mt5_base_slovak_news +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_slovak_news` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_slovak_news_en_5.4.2_3.0_1724674268541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_slovak_news_en_5.4.2_3.0_1724674268541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_slovak_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_slovak_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_slovak_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/kiviki/mt5-base-sk-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_pipeline_en.md new file mode 100644 index 00000000000000..a8cff247ae1559 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_slovak_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_slovak_news_pipeline pipeline T5Transformer from kiviki +author: John Snow Labs +name: mt5_base_slovak_news_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_slovak_news_pipeline` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_slovak_news_pipeline_en_5.4.2_3.0_1724674422868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_slovak_news_pipeline_en_5.4.2_3.0_1724674422868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_slovak_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_slovak_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_slovak_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/kiviki/mt5-base-sk-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_es.md new file mode 100644 index 00000000000000..fbc996ec7b8135 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_translation_spa_pbb T5Transformer from Broomva +author: John Snow Labs +name: mt5_base_translation_spa_pbb +date: 2024-08-26 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_translation_spa_pbb` is a Castilian, Spanish model originally trained by Broomva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_translation_spa_pbb_es_5.4.2_3.0_1724670850923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_translation_spa_pbb_es_5.4.2_3.0_1724670850923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_translation_spa_pbb","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_translation_spa_pbb", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_translation_spa_pbb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|2.3 GB| + +## References + +https://huggingface.co/Broomva/mt5-base-translation-spa-pbb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_pipeline_es.md new file mode 100644 index 00000000000000..9c227539ec0d3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_translation_spa_pbb_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_base_translation_spa_pbb_pipeline pipeline T5Transformer from Broomva +author: John Snow Labs +name: mt5_base_translation_spa_pbb_pipeline +date: 2024-08-26 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_translation_spa_pbb_pipeline` is a Castilian, Spanish model originally trained by Broomva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_translation_spa_pbb_pipeline_es_5.4.2_3.0_1724671099841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_translation_spa_pbb_pipeline_es_5.4.2_3.0_1724671099841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_translation_spa_pbb_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_translation_spa_pbb_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_translation_spa_pbb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|2.3 GB| + +## References + +https://huggingface.co/Broomva/mt5-base-translation-spa-pbb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_en.md new file mode 100644 index 00000000000000..d28559dad071ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_15000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_15000_en_5.4.2_3.0_1724699427256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_15000_en_5.4.2_3.0_1724699427256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_pipeline_en.md new file mode 100644 index 00000000000000..18eb256dfd709c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_15000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724699581859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724699581859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_spanish_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_spanish_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_en.md new file mode 100644 index 00000000000000..128fd53b9a44be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_75000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_75000_en_5.4.2_3.0_1724640650183.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_75000_en_5.4.2_3.0_1724640650183.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_pipeline_en.md new file mode 100644 index 00000000000000..83e9f8689b8a41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_trimmed_spanish_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_75000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_75000_pipeline_en_5.4.2_3.0_1724640896492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_75000_pipeline_en_5.4.2_3.0_1724640896492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_spanish_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_spanish_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_base_zhquad_ae_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_zhquad_ae_pipeline_zh.md new file mode 100644 index 00000000000000..702fe476534fee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_base_zhquad_ae_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese mt5_base_zhquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_zhquad_ae_pipeline +date: 2024-08-26 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_zhquad_ae_pipeline` is a Chinese model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_pipeline_zh_5.4.2_3.0_1724674240697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_pipeline_zh_5.4.2_3.0_1724674240697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_zhquad_ae_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_zhquad_ae_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_zhquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-zhquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_en.md new file mode 100644 index 00000000000000..e803da6c942980 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_baskotayunisha T5Transformer from baskotayunisha +author: John Snow Labs +name: mt5_baskotayunisha +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_baskotayunisha` is a English model originally trained by baskotayunisha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_baskotayunisha_en_5.4.2_3.0_1724698356312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_baskotayunisha_en_5.4.2_3.0_1724698356312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_baskotayunisha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_baskotayunisha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_baskotayunisha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/baskotayunisha/mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_pipeline_en.md new file mode 100644 index 00000000000000..1102387d258cea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_baskotayunisha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_baskotayunisha_pipeline pipeline T5Transformer from baskotayunisha +author: John Snow Labs +name: mt5_baskotayunisha_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_baskotayunisha_pipeline` is a English model originally trained by baskotayunisha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_baskotayunisha_pipeline_en_5.4.2_3.0_1724698450166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_baskotayunisha_pipeline_en_5.4.2_3.0_1724698450166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_baskotayunisha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_baskotayunisha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_baskotayunisha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/baskotayunisha/mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_en.md new file mode 100644 index 00000000000000..2e17e4ab7e89e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_correct_puntuation T5Transformer from jamie613 +author: John Snow Labs +name: mt5_correct_puntuation +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_correct_puntuation` is a English model originally trained by jamie613. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_correct_puntuation_en_5.4.2_3.0_1724638845117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_correct_puntuation_en_5.4.2_3.0_1724638845117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_correct_puntuation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_correct_puntuation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_correct_puntuation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/jamie613/mt5_correct_puntuation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_pipeline_en.md new file mode 100644 index 00000000000000..d8dabe1f5834cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_correct_puntuation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_correct_puntuation_pipeline pipeline T5Transformer from jamie613 +author: John Snow Labs +name: mt5_correct_puntuation_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_correct_puntuation_pipeline` is a English model originally trained by jamie613. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_correct_puntuation_pipeline_en_5.4.2_3.0_1724638987229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_correct_puntuation_pipeline_en_5.4.2_3.0_1724638987229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_correct_puntuation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_correct_puntuation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_correct_puntuation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/jamie613/mt5_correct_puntuation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_en.md new file mode 100644 index 00000000000000..49a893c60449fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_portuguese_translation_v2 T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_english_portuguese_translation_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_portuguese_translation_v2` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_portuguese_translation_v2_en_5.4.2_3.0_1724651660226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_portuguese_translation_v2_en_5.4.2_3.0_1724651660226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_portuguese_translation_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_portuguese_translation_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_portuguese_translation_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-en-pt-translation-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_pipeline_en.md new file mode 100644 index 00000000000000..579a895be0ed15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_english_portuguese_translation_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_english_portuguese_translation_v2_pipeline pipeline T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_english_portuguese_translation_v2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_portuguese_translation_v2_pipeline` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_portuguese_translation_v2_pipeline_en_5.4.2_3.0_1724651857372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_portuguese_translation_v2_pipeline_en_5.4.2_3.0_1724651857372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_english_portuguese_translation_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_english_portuguese_translation_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_portuguese_translation_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-en-pt-translation-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_en.md new file mode 100644 index 00000000000000..31e0f4c4ddfac9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_fill_puntuation T5Transformer from jamie613 +author: John Snow Labs +name: mt5_fill_puntuation +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fill_puntuation` is a English model originally trained by jamie613. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fill_puntuation_en_5.4.2_3.0_1724636155261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fill_puntuation_en_5.4.2_3.0_1724636155261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_fill_puntuation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_fill_puntuation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fill_puntuation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/jamie613/mt5_fill_puntuation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_pipeline_en.md new file mode 100644 index 00000000000000..a9e57cf2673d84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_fill_puntuation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_fill_puntuation_pipeline pipeline T5Transformer from jamie613 +author: John Snow Labs +name: mt5_fill_puntuation_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fill_puntuation_pipeline` is a English model originally trained by jamie613. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fill_puntuation_pipeline_en_5.4.2_3.0_1724636302763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fill_puntuation_pipeline_en_5.4.2_3.0_1724636302763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_fill_puntuation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_fill_puntuation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fill_puntuation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/jamie613/mt5_fill_puntuation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_en.md new file mode 100644 index 00000000000000..722a1d3da161ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_rajknakka T5Transformer from RajkNakka +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_rajknakka +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_rajknakka` is a English model originally trained by RajkNakka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_en_5.4.2_3.0_1724656117680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_en_5.4.2_3.0_1724656117680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_rajknakka","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_rajknakka", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_rajknakka| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/RajkNakka/mt5-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline_en.md new file mode 100644 index 00000000000000..aa638b965de410 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline pipeline T5Transformer from RajkNakka +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline` is a English model originally trained by RajkNakka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline_en_5.4.2_3.0_1724656275694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline_en_5.4.2_3.0_1724656275694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_rajknakka_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/RajkNakka/mt5-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_bg.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_bg.md new file mode 100644 index 00000000000000..22646753a5874c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_bg.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Bulgarian mt5_finetuned_bulgarian_grammar_mistakes T5Transformer from thebogko +author: John Snow Labs +name: mt5_finetuned_bulgarian_grammar_mistakes +date: 2024-08-26 +tags: [bg, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: bg +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_bulgarian_grammar_mistakes` is a Bulgarian model originally trained by thebogko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_bulgarian_grammar_mistakes_bg_5.4.2_3.0_1724710839448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_bulgarian_grammar_mistakes_bg_5.4.2_3.0_1724710839448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_bulgarian_grammar_mistakes","bg") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_bulgarian_grammar_mistakes", "bg") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_bulgarian_grammar_mistakes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|bg| +|Size:|2.3 GB| + +## References + +https://huggingface.co/thebogko/mt5-finetuned-bulgarian-grammar-mistakes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_pipeline_bg.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_pipeline_bg.md new file mode 100644 index 00000000000000..cfe9f3364519bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_finetuned_bulgarian_grammar_mistakes_pipeline_bg.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Bulgarian mt5_finetuned_bulgarian_grammar_mistakes_pipeline pipeline T5Transformer from thebogko +author: John Snow Labs +name: mt5_finetuned_bulgarian_grammar_mistakes_pipeline +date: 2024-08-26 +tags: [bg, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: bg +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_bulgarian_grammar_mistakes_pipeline` is a Bulgarian model originally trained by thebogko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_bulgarian_grammar_mistakes_pipeline_bg_5.4.2_3.0_1724711008021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_bulgarian_grammar_mistakes_pipeline_bg_5.4.2_3.0_1724711008021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_bulgarian_grammar_mistakes_pipeline", lang = "bg") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_bulgarian_grammar_mistakes_pipeline", lang = "bg") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_bulgarian_grammar_mistakes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|bg| +|Size:|2.3 GB| + +## References + +https://huggingface.co/thebogko/mt5-finetuned-bulgarian-grammar-mistakes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_fr.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_fr.md new file mode 100644 index 00000000000000..3874dbd68e938a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_french_fon_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_french_fon_news +date: 2024-08-26 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_french_fon_news` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_french_fon_news_fr_5.4.2_3.0_1724673763673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_french_fon_news_fr_5.4.2_3.0_1724673763673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_french_fon_news","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_french_fon_news", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_french_fon_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_fr_fon_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_pipeline_fr.md new file mode 100644 index 00000000000000..bc32343e37788b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_french_fon_news_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_french_fon_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: mt5_french_fon_news_pipeline +date: 2024-08-26 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_french_fon_news_pipeline` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_french_fon_news_pipeline_fr_5.4.2_3.0_1724674076037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_french_fon_news_pipeline_fr_5.4.2_3.0_1724674076037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_french_fon_news_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_french_fon_news_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_french_fon_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_fr_fon_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_en.md new file mode 100644 index 00000000000000..5aa42caf47eebc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_health_nepali T5Transformer from Chhabi +author: John Snow Labs +name: mt5_health_nepali +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_health_nepali` is a English model originally trained by Chhabi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_health_nepali_en_5.4.2_3.0_1724707733466.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_health_nepali_en_5.4.2_3.0_1724707733466.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_health_nepali","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_health_nepali", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_health_nepali| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Chhabi/mt5-Health-Nepali \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_pipeline_en.md new file mode 100644 index 00000000000000..e4bd3491c59de7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_health_nepali_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_health_nepali_pipeline pipeline T5Transformer from Chhabi +author: John Snow Labs +name: mt5_health_nepali_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_health_nepali_pipeline` is a English model originally trained by Chhabi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_health_nepali_pipeline_en_5.4.2_3.0_1724707827995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_health_nepali_pipeline_en_5.4.2_3.0_1724707827995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_health_nepali_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_health_nepali_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_health_nepali_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Chhabi/mt5-Health-Nepali + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_en.md new file mode 100644 index 00000000000000..742139481fcca5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_nestoralvaro_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_nestoralvaro_normail +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_nestoralvaro_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_nestoralvaro_normail_en_5.4.2_3.0_1724703364904.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_nestoralvaro_normail_en_5.4.2_3.0_1724703364904.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_nestoralvaro_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_nestoralvaro_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_nestoralvaro_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5-nestoralvaro-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_pipeline_en.md new file mode 100644 index 00000000000000..4a5073d6adf89e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_nestoralvaro_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_nestoralvaro_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_nestoralvaro_normail_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_nestoralvaro_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_nestoralvaro_normail_pipeline_en_5.4.2_3.0_1724703528222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_nestoralvaro_normail_pipeline_en_5.4.2_3.0_1724703528222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_nestoralvaro_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_nestoralvaro_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_nestoralvaro_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5-nestoralvaro-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_en.md new file mode 100644 index 00000000000000..48cc5443bb91e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_semantic T5Transformer from devagonal +author: John Snow Labs +name: mt5_semantic +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_semantic` is a English model originally trained by devagonal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_semantic_en_5.4.2_3.0_1724694636754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_semantic_en_5.4.2_3.0_1724694636754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_semantic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_semantic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_semantic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/devagonal/mt5-semantic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_pipeline_en.md new file mode 100644 index 00000000000000..7227937d2cb9cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_semantic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_semantic_pipeline pipeline T5Transformer from devagonal +author: John Snow Labs +name: mt5_semantic_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_semantic_pipeline` is a English model originally trained by devagonal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_semantic_pipeline_en_5.4.2_3.0_1724694812793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_semantic_pipeline_en_5.4.2_3.0_1724694812793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_semantic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_semantic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_semantic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/devagonal/mt5-semantic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_en.md new file mode 100644 index 00000000000000..0df3a52e44b963 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_simplification_spanish T5Transformer from CLARA-MeD +author: John Snow Labs +name: mt5_simplification_spanish +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_simplification_spanish` is a English model originally trained by CLARA-MeD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_simplification_spanish_en_5.4.2_3.0_1724652073167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_simplification_spanish_en_5.4.2_3.0_1724652073167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_simplification_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_simplification_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_simplification_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/CLARA-MeD/mt5-simplification-spanish \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_pipeline_en.md new file mode 100644 index 00000000000000..5d799d1bd23c4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_simplification_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_simplification_spanish_pipeline pipeline T5Transformer from CLARA-MeD +author: John Snow Labs +name: mt5_simplification_spanish_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_simplification_spanish_pipeline` is a English model originally trained by CLARA-MeD. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_simplification_spanish_pipeline_en_5.4.2_3.0_1724652161125.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_simplification_spanish_pipeline_en_5.4.2_3.0_1724652161125.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_simplification_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_simplification_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_simplification_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/CLARA-MeD/mt5-simplification-spanish + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_en.md new file mode 100644 index 00000000000000..0b8a7bd9ac013a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_20000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_20000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_20000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_20000_en_5.4.2_3.0_1724708923141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_20000_en_5.4.2_3.0_1724708923141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_20000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_20000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_20000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_20000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_pipeline_en.md new file mode 100644 index 00000000000000..4c58f985abd1e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_20000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_20000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_20000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_20000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_20000_pipeline_en_5.4.2_3.0_1724709049981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_20000_pipeline_en_5.4.2_3.0_1724709049981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_20000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_20000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_20000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_20000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_en.md new file mode 100644 index 00000000000000..c12840da88b256 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_corrupted_zarma12 T5Transformer from Mamadou2727 +author: John Snow Labs +name: mt5_small_corrupted_zarma12 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_corrupted_zarma12` is a English model originally trained by Mamadou2727. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_corrupted_zarma12_en_5.4.2_3.0_1724651709124.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_corrupted_zarma12_en_5.4.2_3.0_1724651709124.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_corrupted_zarma12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_corrupted_zarma12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_corrupted_zarma12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Mamadou2727/mt5-small-Corrupted-Zarma12 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_pipeline_en.md new file mode 100644 index 00000000000000..e7190dc8a6ec5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_corrupted_zarma12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_corrupted_zarma12_pipeline pipeline T5Transformer from Mamadou2727 +author: John Snow Labs +name: mt5_small_corrupted_zarma12_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_corrupted_zarma12_pipeline` is a English model originally trained by Mamadou2727. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_corrupted_zarma12_pipeline_en_5.4.2_3.0_1724651804306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_corrupted_zarma12_pipeline_en_5.4.2_3.0_1724651804306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_corrupted_zarma12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_corrupted_zarma12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_corrupted_zarma12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Mamadou2727/mt5-small-Corrupted-Zarma12 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_ae_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_ae_pipeline_de.md new file mode 100644 index 00000000000000..37f02d85b046fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_ae_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German mt5_small_dequad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_ae_pipeline +date: 2024-08-26 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_ae_pipeline` is a German model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_pipeline_de_5.4.2_3.0_1724670006495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_ae_pipeline_de_5.4.2_3.0_1724670006495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_dequad_ae_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_dequad_ae_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_de.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_de.md new file mode 100644 index 00000000000000..86cb3c87ffc87e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German mt5_small_dequad_qa T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_qa +date: 2024-08-26 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_qa` is a German model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qa_de_5.4.2_3.0_1724685384728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qa_de_5.4.2_3.0_1724685384728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_dequad_qa","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_dequad_qa", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_pipeline_de.md new file mode 100644 index 00000000000000..74dd6e86a0c496 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qa_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German mt5_small_dequad_qa_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_qa_pipeline +date: 2024-08-26 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_qa_pipeline` is a German model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qa_pipeline_de_5.4.2_3.0_1724685479336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qa_pipeline_de_5.4.2_3.0_1724685479336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_dequad_qa_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_dequad_qa_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..747ee3ac641e06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_dequad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_qag_trimmed_50000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qag_trimmed_50000_en_5.4.2_3.0_1724641256653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qag_trimmed_50000_en_5.4.2_3.0_1724641256653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_dequad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_dequad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|409.7 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..de657817cdddbf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_dequad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_dequad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_dequad_qag_trimmed_50000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_dequad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724641286030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_dequad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724641286030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_dequad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_dequad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_dequad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|409.7 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-dequad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..07c33639144b76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_esquad_ae_trimmed_50000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_ae_trimmed_50000_en_5.4.2_3.0_1724657586075.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_ae_trimmed_50000_en_5.4.2_3.0_1724657586075.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|433.4 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-esquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..0f79889d5d92d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_esquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_esquad_ae_trimmed_50000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724657607871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724657607871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|433.4 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-esquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_en.md new file mode 100644 index 00000000000000..5289d90cee5e69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_1_1_0 T5Transformer from jamesesguerra +author: John Snow Labs +name: mt5_small_finetuned_1_1_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1_1_0` is a English model originally trained by jamesesguerra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_1_0_en_5.4.2_3.0_1724712495398.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_1_0_en_5.4.2_3.0_1724712495398.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_1_1_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_1_1_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1_1_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/jamesesguerra/mt5-small-finetuned-1.1.0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_pipeline_en.md new file mode 100644 index 00000000000000..75cea9c0d74351 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_1_1_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_1_1_0_pipeline pipeline T5Transformer from jamesesguerra +author: John Snow Labs +name: mt5_small_finetuned_1_1_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1_1_0_pipeline` is a English model originally trained by jamesesguerra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_1_0_pipeline_en_5.4.2_3.0_1724712608791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_1_0_pipeline_en_5.4.2_3.0_1724712608791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_1_1_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_1_1_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1_1_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/jamesesguerra/mt5-small-finetuned-1.1.0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_en.md new file mode 100644 index 00000000000000..bc230762d8b2e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_24feb_2 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24feb_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24feb_2` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_2_en_5.4.2_3.0_1724666528793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_2_en_5.4.2_3.0_1724666528793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_24feb_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_24feb_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24feb_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24feb-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_pipeline_en.md new file mode 100644 index 00000000000000..494356ca2564bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_24feb_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_24feb_2_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24feb_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24feb_2_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_2_pipeline_en_5.4.2_3.0_1724666624199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24feb_2_pipeline_en_5.4.2_3.0_1724666624199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_24feb_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_24feb_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24feb_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24feb-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_en.md new file mode 100644 index 00000000000000..b6b9367b9349df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_25feb_4 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_25feb_4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_25feb_4` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_4_en_5.4.2_3.0_1724673625535.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_4_en_5.4.2_3.0_1724673625535.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_25feb_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_25feb_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_25feb_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-25feb-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_pipeline_en.md new file mode 100644 index 00000000000000..c0f87f79d47360 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_25feb_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_25feb_4_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_25feb_4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_25feb_4_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_4_pipeline_en_5.4.2_3.0_1724673722875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_25feb_4_pipeline_en_5.4.2_3.0_1724673722875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_25feb_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_25feb_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_25feb_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-25feb-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_en.md new file mode 100644 index 00000000000000..8ed4f808164f35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_deepakpurandare T5Transformer from deepakpurandare +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_deepakpurandare +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_deepakpurandare` is a English model originally trained by deepakpurandare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_deepakpurandare_en_5.4.2_3.0_1724646649501.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_deepakpurandare_en_5.4.2_3.0_1724646649501.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_deepakpurandare","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_deepakpurandare", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_deepakpurandare| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/deepakpurandare/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline_en.md new file mode 100644 index 00000000000000..e8e4a964aa9727 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline pipeline T5Transformer from deepakpurandare +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline` is a English model originally trained by deepakpurandare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline_en_5.4.2_3.0_1724646740795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline_en_5.4.2_3.0_1724646740795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_deepakpurandare_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/deepakpurandare/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_en.md new file mode 100644 index 00000000000000..3186210dfc9ce7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hulentina T5Transformer from hulentina +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hulentina +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hulentina` is a English model originally trained by hulentina. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hulentina_en_5.4.2_3.0_1724652626344.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hulentina_en_5.4.2_3.0_1724652626344.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hulentina","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hulentina", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hulentina| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hulentina/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline_en.md new file mode 100644 index 00000000000000..c9762f7cfb8c11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline pipeline T5Transformer from hulentina +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline` is a English model originally trained by hulentina. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline_en_5.4.2_3.0_1724652718955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline_en_5.4.2_3.0_1724652718955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hulentina_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hulentina/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_en.md new file mode 100644 index 00000000000000..708a5bf727fcf1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_julia_s T5Transformer from julia-s +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_julia_s +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_julia_s` is a English model originally trained by julia-s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_julia_s_en_5.4.2_3.0_1724650837694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_julia_s_en_5.4.2_3.0_1724650837694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_julia_s","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_julia_s", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_julia_s| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/julia-s/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline_en.md new file mode 100644 index 00000000000000..e6c769f9aab65d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline pipeline T5Transformer from julia-s +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline` is a English model originally trained by julia-s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline_en_5.4.2_3.0_1724650928248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline_en_5.4.2_3.0_1724650928248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_julia_s_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/julia-s/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_en.md new file mode 100644 index 00000000000000..e14c9248031588 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_radicion T5Transformer from radicion +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_radicion +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_radicion` is a English model originally trained by radicion. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_radicion_en_5.4.2_3.0_1724651051947.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_radicion_en_5.4.2_3.0_1724651051947.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_radicion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_radicion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_radicion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/radicion/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_pipeline_en.md new file mode 100644 index 00000000000000..b48e6964d06daf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_radicion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_radicion_pipeline pipeline T5Transformer from radicion +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_radicion_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_radicion_pipeline` is a English model originally trained by radicion. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_radicion_pipeline_en_5.4.2_3.0_1724651151840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_radicion_pipeline_en_5.4.2_3.0_1724651151840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_radicion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_radicion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_radicion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/radicion/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_en.md new file mode 100644 index 00000000000000..0bf076e85cf666 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_yuto01 T5Transformer from Yuto01 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_yuto01 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_yuto01` is a English model originally trained by Yuto01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_yuto01_en_5.4.2_3.0_1724652942241.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_yuto01_en_5.4.2_3.0_1724652942241.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_yuto01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_yuto01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_yuto01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Yuto01/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline_en.md new file mode 100644 index 00000000000000..a90f924ab72bdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline pipeline T5Transformer from Yuto01 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline` is a English model originally trained by Yuto01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline_en_5.4.2_3.0_1724653032997.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline_en_5.4.2_3.0_1724653032997.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_yuto01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Yuto01/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_en.md new file mode 100644 index 00000000000000..812a37a2355319 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_b8_e10_1024_128 T5Transformer from sharkMeow +author: John Snow Labs +name: mt5_small_finetuned_b8_e10_1024_128 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_b8_e10_1024_128` is a English model originally trained by sharkMeow. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_b8_e10_1024_128_en_5.4.2_3.0_1724715813717.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_b8_e10_1024_128_en_5.4.2_3.0_1724715813717.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_b8_e10_1024_128","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_b8_e10_1024_128", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_b8_e10_1024_128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/sharkMeow/mt5-small-finetuned-b8-e10-1024-128 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_pipeline_en.md new file mode 100644 index 00000000000000..9d68254a24d399 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_b8_e10_1024_128_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_b8_e10_1024_128_pipeline pipeline T5Transformer from sharkMeow +author: John Snow Labs +name: mt5_small_finetuned_b8_e10_1024_128_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_b8_e10_1024_128_pipeline` is a English model originally trained by sharkMeow. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_b8_e10_1024_128_pipeline_en_5.4.2_3.0_1724715941873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_b8_e10_1024_128_pipeline_en_5.4.2_3.0_1724715941873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_b8_e10_1024_128_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_b8_e10_1024_128_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_b8_e10_1024_128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/sharkMeow/mt5-small-finetuned-b8-e10-1024-128 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_en.md new file mode 100644 index 00000000000000..076c77e99b909c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_gec T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_gec +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_gec` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_en_5.4.2_3.0_1724674448871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_en_5.4.2_3.0_1724674448871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_pipeline_en.md new file mode 100644 index 00000000000000..fddec9579878a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_gec_pipeline pipeline T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_gec_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_gec_pipeline` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_pipeline_en_5.4.2_3.0_1724674543854.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_gec_pipeline_en_5.4.2_3.0_1724674543854.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_en.md new file mode 100644 index 00000000000000..7d0ef0adb62ce7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_mt5_summarization_task T5Transformer from nour4286 +author: John Snow Labs +name: mt5_small_finetuned_mt5_summarization_task +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mt5_summarization_task` is a English model originally trained by nour4286. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_summarization_task_en_5.4.2_3.0_1724689266486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_summarization_task_en_5.4.2_3.0_1724689266486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_mt5_summarization_task","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_mt5_summarization_task", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mt5_summarization_task| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/nour4286/mt5-small-finetuned-mt5-summarization-task \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_pipeline_en.md new file mode 100644 index 00000000000000..ed80d8b92d93af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_mt5_summarization_task_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_mt5_summarization_task_pipeline pipeline T5Transformer from nour4286 +author: John Snow Labs +name: mt5_small_finetuned_mt5_summarization_task_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_mt5_summarization_task_pipeline` is a English model originally trained by nour4286. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_summarization_task_pipeline_en_5.4.2_3.0_1724689362546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_mt5_summarization_task_pipeline_en_5.4.2_3.0_1724689362546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_mt5_summarization_task_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_mt5_summarization_task_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_mt5_summarization_task_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/nour4286/mt5-small-finetuned-mt5-summarization-task + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_en.md new file mode 100644 index 00000000000000..e54da52e884c17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_plos T5Transformer from ycool +author: John Snow Labs +name: mt5_small_finetuned_plos +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_plos` is a English model originally trained by ycool. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_plos_en_5.4.2_3.0_1724664666584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_plos_en_5.4.2_3.0_1724664666584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_plos","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_plos", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_plos| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/ycool/mt5-small-finetuned-plos \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_pipeline_en.md new file mode 100644 index 00000000000000..c459263b71f08a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_plos_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_plos_pipeline pipeline T5Transformer from ycool +author: John Snow Labs +name: mt5_small_finetuned_plos_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_plos_pipeline` is a English model originally trained by ycool. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_plos_pipeline_en_5.4.2_3.0_1724664672765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_plos_pipeline_en_5.4.2_3.0_1724664672765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_plos_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_plos_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_plos_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/ycool/mt5-small-finetuned-plos + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_en.md new file mode 100644 index 00000000000000..42f3a43cf856f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_portuguese_gec T5Transformer from tdperez +author: John Snow Labs +name: mt5_small_finetuned_portuguese_gec +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_portuguese_gec` is a English model originally trained by tdperez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_portuguese_gec_en_5.4.2_3.0_1724666578673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_portuguese_gec_en_5.4.2_3.0_1724666578673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_portuguese_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_portuguese_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_portuguese_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tdperez/mt5-small-finetuned-pt-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_pipeline_en.md new file mode 100644 index 00000000000000..dfa4916b346b08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_portuguese_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_portuguese_gec_pipeline pipeline T5Transformer from tdperez +author: John Snow Labs +name: mt5_small_finetuned_portuguese_gec_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_portuguese_gec_pipeline` is a English model originally trained by tdperez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_portuguese_gec_pipeline_en_5.4.2_3.0_1724666721740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_portuguese_gec_pipeline_en_5.4.2_3.0_1724666721740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_portuguese_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_portuguese_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_portuguese_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tdperez/mt5-small-finetuned-pt-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_en.md new file mode 100644 index 00000000000000..c7adaa1065e2d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_wikisql2_adityarao1612 T5Transformer from adityarao1612 +author: John Snow Labs +name: mt5_small_finetuned_wikisql2_adityarao1612 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_wikisql2_adityarao1612` is a English model originally trained by adityarao1612. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikisql2_adityarao1612_en_5.4.2_3.0_1724682702305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikisql2_adityarao1612_en_5.4.2_3.0_1724682702305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_wikisql2_adityarao1612","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_wikisql2_adityarao1612", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_wikisql2_adityarao1612| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adityarao1612/mt5-small-finetuned-wikisql2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_pipeline_en.md new file mode 100644 index 00000000000000..88f23f52200ea4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_finetuned_wikisql2_adityarao1612_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_wikisql2_adityarao1612_pipeline pipeline T5Transformer from adityarao1612 +author: John Snow Labs +name: mt5_small_finetuned_wikisql2_adityarao1612_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_wikisql2_adityarao1612_pipeline` is a English model originally trained by adityarao1612. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikisql2_adityarao1612_pipeline_en_5.4.2_3.0_1724682872727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_wikisql2_adityarao1612_pipeline_en_5.4.2_3.0_1724682872727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_wikisql2_adityarao1612_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_wikisql2_adityarao1612_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_wikisql2_adityarao1612_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adityarao1612/mt5-small-finetuned-wikisql2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_en.md new file mode 100644 index 00000000000000..1f16c73f7c33cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_30000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_30000_en_5.4.2_3.0_1724709196730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_30000_en_5.4.2_3.0_1724709196730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_pipeline_en.md new file mode 100644 index 00000000000000..71cedc8c19b408 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qa_trimmed_french_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_30000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_30000_pipeline_en_5.4.2_3.0_1724709213868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_30000_pipeline_en_5.4.2_3.0_1724709213868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_fr.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_fr.md new file mode 100644 index 00000000000000..065aae6e517562 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_frquad_qag T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_frquad_qag +date: 2024-08-26 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qag` is a French model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qag_fr_5.4.2_3.0_1724688537700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qag_fr_5.4.2_3.0_1724688537700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qag","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qag", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-frquad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_pipeline_fr.md new file mode 100644 index 00000000000000..5494cb6fe70e65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qag_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_frquad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_frquad_qag_pipeline +date: 2024-08-26 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qag_pipeline` is a French model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qag_pipeline_fr_5.4.2_3.0_1724688632620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qag_pipeline_fr_5.4.2_3.0_1724688632620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qag_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qag_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-frquad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..42f131317ba7a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_frquad_qg_ae_trimmed_50000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724680298882.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724680298882.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|414.1 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-frquad-qg-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..d57f07af463c88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_frquad_qg_ae_trimmed_50000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724680325555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724680325555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|414.1 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-frquad-qg-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_en.md new file mode 100644 index 00000000000000..1c0edc3d6cbfd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_120000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_120000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_120000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_120000_en_5.4.2_3.0_1724707526584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_120000_en_5.4.2_3.0_1724707526584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|702.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_pipeline_en.md new file mode 100644 index 00000000000000..4018b91a8bef9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_frquad_qg_trimmed_french_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_120000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_120000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_120000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724707573949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724707573949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|702.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_it.md new file mode 100644 index 00000000000000..de8c6d93d68c97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_itquad_qg T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg +date: 2024-08-26 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_it_5.4.2_3.0_1724636063850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_it_5.4.2_3.0_1724636063850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qg","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qg", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|1.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_pipeline_it.md new file mode 100644 index 00000000000000..d3fb30c01b17ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_itquad_qg_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_itquad_qg_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_pipeline +date: 2024-08-26 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_pipeline` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_pipeline_it_5.4.2_3.0_1724636153677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_pipeline_it_5.4.2_3.0_1724636153677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qg_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qg_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|1.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_en.md new file mode 100644 index 00000000000000..44c48f14cb9458 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_lithuanian_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_lithuanian_10k +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_lithuanian_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_lithuanian_10k_en_5.4.2_3.0_1724693643281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_lithuanian_10k_en_5.4.2_3.0_1724693643281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_lithuanian_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_lithuanian_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_lithuanian_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-lt-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_pipeline_en.md new file mode 100644 index 00000000000000..6ffef9bd911228 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_lithuanian_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_lithuanian_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_lithuanian_10k_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_lithuanian_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_lithuanian_10k_pipeline_en_5.4.2_3.0_1724693792170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_lithuanian_10k_pipeline_en_5.4.2_3.0_1724693792170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_lithuanian_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_lithuanian_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_lithuanian_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-lt-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_en.md new file mode 100644 index 00000000000000..cb2ea0be7e4c5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_400_ptes T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_ptes +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_ptes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ptes_en_5.4.2_3.0_1724646609228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ptes_en_5.4.2_3.0_1724646609228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_400_ptes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_400_ptes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_ptes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-ptes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_pipeline_en.md new file mode 100644 index 00000000000000..5d872086db7e41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ptes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_400_ptes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_ptes_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_ptes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ptes_pipeline_en_5.4.2_3.0_1724646802499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ptes_pipeline_en_5.4.2_3.0_1724646802499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_400_ptes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_400_ptes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_ptes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-ptes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_en.md new file mode 100644 index 00000000000000..3a30407a1142b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_400_ruen T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_ruen +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_ruen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ruen_en_5.4.2_3.0_1724657612807.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ruen_en_5.4.2_3.0_1724657612807.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_400_ruen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_400_ruen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_ruen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-ruen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_pipeline_en.md new file mode 100644 index 00000000000000..0766e18c791f79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_400_ruen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_400_ruen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_ruen_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_ruen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ruen_pipeline_en_5.4.2_3.0_1724657810723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_ruen_pipeline_en_5.4.2_3.0_1724657810723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_400_ruen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_400_ruen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_ruen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-ruen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_en.md new file mode 100644 index 00000000000000..6db5d563c66c42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_50k_enru T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_50k_enru +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_50k_enru` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_enru_en_5.4.2_3.0_1724655375906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_enru_en_5.4.2_3.0_1724655375906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_50k_enru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_50k_enru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_50k_enru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-50k-enru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_pipeline_en.md new file mode 100644 index 00000000000000..ff5d14fe9e9298 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_nc16_50k_enru_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_50k_enru_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_50k_enru_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_50k_enru_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_enru_pipeline_en_5.4.2_3.0_1724655551337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_50k_enru_pipeline_en_5.4.2_3.0_1724655551337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_50k_enru_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_50k_enru_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_50k_enru_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-50k-enru + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_en.md new file mode 100644 index 00000000000000..0c3a216cafb8de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_oriya_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_oriya_10k +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_oriya_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_oriya_10k_en_5.4.2_3.0_1724709563380.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_oriya_10k_en_5.4.2_3.0_1724709563380.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_oriya_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_oriya_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_oriya_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-or-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_pipeline_en.md new file mode 100644 index 00000000000000..481db6bfc38459 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_oriya_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_oriya_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_oriya_10k_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_oriya_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_oriya_10k_pipeline_en_5.4.2_3.0_1724709738635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_oriya_10k_pipeline_en_5.4.2_3.0_1724709738635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_oriya_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_oriya_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_oriya_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-or-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..9ab79d519c70e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english T5Transformer from PontifexMaximus +author: John Snow Labs +name: mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english` is a English model originally trained by PontifexMaximus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_en_5.4.2_3.0_1724640888137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_en_5.4.2_3.0_1724640888137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PontifexMaximus/mt5-small-parsinlu-opus-translation_fa_en-finetuned-fa-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..9113cda8ccefc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline pipeline T5Transformer from PontifexMaximus +author: John Snow Labs +name: mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline` is a English model originally trained by PontifexMaximus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724641081234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724641081234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_parsinlu_opus_translation_persian_farsi_english_finetuned_persian_farsi_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PontifexMaximus/mt5-small-parsinlu-opus-translation_fa_en-finetuned-fa-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_fa.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_fa.md new file mode 100644 index 00000000000000..c56372d59d05c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_fa.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Persian mt5_small_parsinlu_sentiment_analysis T5Transformer from persiannlp +author: John Snow Labs +name: mt5_small_parsinlu_sentiment_analysis +date: 2024-08-26 +tags: [fa, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fa +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_parsinlu_sentiment_analysis` is a Persian model originally trained by persiannlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_sentiment_analysis_fa_5.4.2_3.0_1724630859162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_sentiment_analysis_fa_5.4.2_3.0_1724630859162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_parsinlu_sentiment_analysis","fa") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_parsinlu_sentiment_analysis", "fa") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_parsinlu_sentiment_analysis| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fa| +|Size:|819.7 MB| + +## References + +https://huggingface.co/persiannlp/mt5-small-parsinlu-sentiment-analysis \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_pipeline_fa.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_pipeline_fa.md new file mode 100644 index 00000000000000..df22a48ef4767f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_parsinlu_sentiment_analysis_pipeline_fa.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Persian mt5_small_parsinlu_sentiment_analysis_pipeline pipeline T5Transformer from persiannlp +author: John Snow Labs +name: mt5_small_parsinlu_sentiment_analysis_pipeline +date: 2024-08-26 +tags: [fa, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fa +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_parsinlu_sentiment_analysis_pipeline` is a Persian model originally trained by persiannlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_sentiment_analysis_pipeline_fa_5.4.2_3.0_1724631149962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_parsinlu_sentiment_analysis_pipeline_fa_5.4.2_3.0_1724631149962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_parsinlu_sentiment_analysis_pipeline", lang = "fa") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_parsinlu_sentiment_analysis_pipeline", lang = "fa") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_parsinlu_sentiment_analysis_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fa| +|Size:|819.7 MB| + +## References + +https://huggingface.co/persiannlp/mt5-small-parsinlu-sentiment-analysis + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_en.md new file mode 100644 index 00000000000000..7d0129ad074442 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qa_trimmed_russian_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qa_trimmed_russian_30000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qa_trimmed_russian_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_30000_en_5.4.2_3.0_1724654517442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_30000_en_5.4.2_3.0_1724654517442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qa_trimmed_russian_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qa_trimmed_russian_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qa_trimmed_russian_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qa-trimmed-ru-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_pipeline_en.md new file mode 100644 index 00000000000000..176044fa113475 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qa_trimmed_russian_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qa_trimmed_russian_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qa_trimmed_russian_30000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qa_trimmed_russian_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_30000_pipeline_en_5.4.2_3.0_1724654533770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qa_trimmed_russian_30000_pipeline_en_5.4.2_3.0_1724654533770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qa_trimmed_russian_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qa_trimmed_russian_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qa_trimmed_russian_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qa-trimmed-ru-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_en.md new file mode 100644 index 00000000000000..35d54b110fab96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_10000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_10000_en_5.4.2_3.0_1724710030022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_10000_en_5.4.2_3.0_1724710030022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_pipeline_en.md new file mode 100644 index 00000000000000..d25bcf74832595 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_ruquad_qg_trimmed_russian_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_10000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_10000_pipeline_en_5.4.2_3.0_1724710041615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_10000_pipeline_en_5.4.2_3.0_1724710041615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|224.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_en.md new file mode 100644 index 00000000000000..7a6bf837b5ced3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_spanish_paraphraser T5Transformer from pserna +author: John Snow Labs +name: mt5_small_spanish_paraphraser +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_spanish_paraphraser` is a English model originally trained by pserna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_spanish_paraphraser_en_5.4.2_3.0_1724669264880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_spanish_paraphraser_en_5.4.2_3.0_1724669264880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_spanish_paraphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_spanish_paraphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_spanish_paraphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/pserna/mt5-small-spanish-paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_pipeline_en.md new file mode 100644 index 00000000000000..b4feb67b0a4e99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_spanish_paraphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_spanish_paraphraser_pipeline pipeline T5Transformer from pserna +author: John Snow Labs +name: mt5_small_spanish_paraphraser_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_spanish_paraphraser_pipeline` is a English model originally trained by pserna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_spanish_paraphraser_pipeline_en_5.4.2_3.0_1724669447646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_spanish_paraphraser_pipeline_en_5.4.2_3.0_1724669447646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_spanish_paraphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_spanish_paraphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_spanish_paraphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/pserna/mt5-small-spanish-paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_en.md new file mode 100644 index 00000000000000..f737b960e3c234 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_task2_dataset1 T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task2_dataset1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task2_dataset1` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset1_en_5.4.2_3.0_1724682280118.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset1_en_5.4.2_3.0_1724682280118.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_task2_dataset1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_task2_dataset1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task2_dataset1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task2-dataset1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_pipeline_en.md new file mode 100644 index 00000000000000..cb717b4514daf0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_task2_dataset1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_task2_dataset1_pipeline pipeline T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task2_dataset1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task2_dataset1_pipeline` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset1_pipeline_en_5.4.2_3.0_1724682401928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task2_dataset1_pipeline_en_5.4.2_3.0_1724682401928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_task2_dataset1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_task2_dataset1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task2_dataset1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task2-dataset1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_en.md new file mode 100644 index 00000000000000..659b95a6fc7d6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tata T5Transformer from adenhaus +author: John Snow Labs +name: mt5_small_tata +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tata` is a English model originally trained by adenhaus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tata_en_5.4.2_3.0_1724702233144.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tata_en_5.4.2_3.0_1724702233144.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tata","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tata", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tata| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adenhaus/mt5-small-tata \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_pipeline_en.md new file mode 100644 index 00000000000000..6e1f2e94ebaa38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_tata_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tata_pipeline pipeline T5Transformer from adenhaus +author: John Snow Labs +name: mt5_small_tata_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tata_pipeline` is a English model originally trained by adenhaus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tata_pipeline_en_5.4.2_3.0_1724702427045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tata_pipeline_en_5.4.2_3.0_1724702427045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tata_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tata_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tata_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/adenhaus/mt5-small-tata + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_en.md new file mode 100644 index 00000000000000..cc5e99a9edb066 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_text_sum_10 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_text_sum_10 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_text_sum_10` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_10_en_5.4.2_3.0_1724709385873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_10_en_5.4.2_3.0_1724709385873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_text_sum_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_text_sum_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_text_sum_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-text-sum-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_pipeline_en.md new file mode 100644 index 00000000000000..6330f0093d862b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_text_sum_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_text_sum_10_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_text_sum_10_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_text_sum_10_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_10_pipeline_en_5.4.2_3.0_1724709481995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_10_pipeline_en_5.4.2_3.0_1724709481995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_text_sum_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_text_sum_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_text_sum_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-text-sum-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_en.md new file mode 100644 index 00000000000000..5d6dd2b61db8ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_en_5.4.2_3.0_1724705855438.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_en_5.4.2_3.0_1724705855438.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|174.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_pipeline_en.md new file mode 100644 index 00000000000000..d615d1e2e161a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_pipeline_en_5.4.2_3.0_1724705916598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_pipeline_en_5.4.2_3.0_1724705916598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|174.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_en.md new file mode 100644 index 00000000000000..97ec2c9f4f7a88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000_squad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000_squad_qa +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000_squad_qa` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qa_en_5.4.2_3.0_1724651958520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qa_en_5.4.2_3.0_1724651958520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000_squad_qa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_30000_squad_qa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000_squad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000-squad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_pipeline_en.md new file mode 100644 index 00000000000000..03c5afede59ed1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_30000_squad_qa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_30000_squad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_30000_squad_qa_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_30000_squad_qa_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qa_pipeline_en_5.4.2_3.0_1724651975224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_30000_squad_qa_pipeline_en_5.4.2_3.0_1724651975224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_30000_squad_qa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_30000_squad_qa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_30000_squad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-30000-squad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_en.md new file mode 100644 index 00000000000000..be534ffe1663c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_60000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_60000_en_5.4.2_3.0_1724657970337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_60000_en_5.4.2_3.0_1724657970337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_pipeline_en.md new file mode 100644 index 00000000000000..74d1a501cdc634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_english_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_60000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724658062322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724658062322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_it.md new file mode 100644 index 00000000000000..c9618f0d230bef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_30000_itquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_30000_itquad_qg +date: 2024-08-26 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_30000_itquad_qg` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_30000_itquad_qg_it_5.4.2_3.0_1724646548766.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_30000_itquad_qg_it_5.4.2_3.0_1724646548766.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_30000_itquad_qg","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_30000_itquad_qg", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_30000_itquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|332.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-30000-itquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_pipeline_it.md new file mode 100644 index 00000000000000..92089be92bafaf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_italian_30000_itquad_qg_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_30000_itquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_30000_itquad_qg_pipeline +date: 2024-08-26 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_30000_itquad_qg_pipeline` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_30000_itquad_qg_pipeline_it_5.4.2_3.0_1724646565169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_30000_itquad_qg_pipeline_it_5.4.2_3.0_1724646565169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_30000_itquad_qg_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_30000_itquad_qg_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_30000_itquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|332.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-30000-itquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_en.md new file mode 100644 index 00000000000000..d8237ccf13c6d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_korean_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_10000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_10000_en_5.4.2_3.0_1724704204690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_10000_en_5.4.2_3.0_1724704204690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_pipeline_en.md new file mode 100644 index 00000000000000..80ee03c38d5164 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_korean_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_10000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_10000_pipeline_en_5.4.2_3.0_1724704245248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_10000_pipeline_en_5.4.2_3.0_1724704245248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|116.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_ko.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_ko.md new file mode 100644 index 00000000000000..11818ad421fe00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_ko.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_60000_koquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_60000_koquad_qg +date: 2024-08-26 +tags: [ko, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_60000_koquad_qg` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_koquad_qg_ko_5.4.2_3.0_1724698612022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_koquad_qg_ko_5.4.2_3.0_1724698612022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_60000_koquad_qg","ko") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_60000_koquad_qg", "ko") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_60000_koquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ko| +|Size:|444.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-60000-koquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_pipeline_ko.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_pipeline_ko.md new file mode 100644 index 00000000000000..2d33256457c662 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_korean_60000_koquad_qg_pipeline_ko.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_60000_koquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_60000_koquad_qg_pipeline +date: 2024-08-26 +tags: [ko, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_60000_koquad_qg_pipeline` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_koquad_qg_pipeline_ko_5.4.2_3.0_1724698638794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_koquad_qg_pipeline_ko_5.4.2_3.0_1724698638794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_60000_koquad_qg_pipeline", lang = "ko") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_60000_koquad_qg_pipeline", lang = "ko") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_60000_koquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ko| +|Size:|444.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-60000-koquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_en.md new file mode 100644 index 00000000000000..f5b56dc5389388 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_15000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_15000_en_5.4.2_3.0_1724673216943.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_15000_en_5.4.2_3.0_1724673216943.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|130.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_pipeline_en.md new file mode 100644 index 00000000000000..3d942ba432c5c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_15000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724673261689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_15000_pipeline_en_5.4.2_3.0_1724673261689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|130.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_es.md new file mode 100644 index 00000000000000..4488f6ae2e7f56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_5000_esquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_5000_esquad_qa +date: 2024-08-26 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_5000_esquad_qa` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_5000_esquad_qa_es_5.4.2_3.0_1724702128637.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_5000_esquad_qa_es_5.4.2_3.0_1724702128637.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_5000_esquad_qa","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_5000_esquad_qa", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_5000_esquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|196.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-5000-esquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_pipeline_es.md new file mode 100644 index 00000000000000..fd2bb3bdc15f77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_small_trimmed_spanish_5000_esquad_qa_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_5000_esquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_5000_esquad_qa_pipeline +date: 2024-08-26 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_5000_esquad_qa_pipeline` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_5000_esquad_qa_pipeline_es_5.4.2_3.0_1724702138740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_5000_esquad_qa_pipeline_es_5.4.2_3.0_1724702138740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_5000_esquad_qa_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_5000_esquad_qa_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_5000_esquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|196.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-5000-esquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_en.md new file mode 100644 index 00000000000000..c002a4c57cf067 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_spelling_czech_small T5Transformer from jjurca +author: John Snow Labs +name: mt5_spelling_czech_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_spelling_czech_small` is a English model originally trained by jjurca. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_spelling_czech_small_en_5.4.2_3.0_1724634008529.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_spelling_czech_small_en_5.4.2_3.0_1724634008529.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_spelling_czech_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_spelling_czech_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_spelling_czech_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/jjurca/mt5-spelling-cs-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_pipeline_en.md new file mode 100644 index 00000000000000..5c5e49069ecaf0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_spelling_czech_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_spelling_czech_small_pipeline pipeline T5Transformer from jjurca +author: John Snow Labs +name: mt5_spelling_czech_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_spelling_czech_small_pipeline` is a English model originally trained by jjurca. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_spelling_czech_small_pipeline_en_5.4.2_3.0_1724634134819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_spelling_czech_small_pipeline_en_5.4.2_3.0_1724634134819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_spelling_czech_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_spelling_czech_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_spelling_czech_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/jjurca/mt5-spelling-cs-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_textsimp_lithuanian_batchsize4_lr5e_5_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_textsimp_lithuanian_batchsize4_lr5e_5_en.md new file mode 100644 index 00000000000000..6a6efbba0f0f03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_textsimp_lithuanian_batchsize4_lr5e_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_textsimp_lithuanian_batchsize4_lr5e_5 T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_textsimp_lithuanian_batchsize4_lr5e_5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_textsimp_lithuanian_batchsize4_lr5e_5` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize4_lr5e_5_en_5.4.2_3.0_1724708904783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize4_lr5e_5_en_5.4.2_3.0_1724708904783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize4_lr5e_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize4_lr5e_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_textsimp_lithuanian_batchsize4_lr5e_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mT5-TextSimp-LT-BatchSize4-lr5e-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_en.md new file mode 100644 index 00000000000000..811399f983755a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_tiny12l T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_tiny12l +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny12l` is a English model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_en_5.4.2_3.0_1724697818055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_en_5.4.2_3.0_1724697818055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_tiny12l","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_tiny12l", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny12l| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|212.1 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5-tiny12L \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_pipeline_en.md new file mode 100644 index 00000000000000..75cfd2bf17a240 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_tiny12l_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_tiny12l_pipeline pipeline T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_tiny12l_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny12l_pipeline` is a English model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_pipeline_en_5.4.2_3.0_1724697828459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_pipeline_en_5.4.2_3.0_1724697828459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_tiny12l_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_tiny12l_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny12l_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|212.1 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5-tiny12L + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_en.md new file mode 100644 index 00000000000000..f108285f19cd86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_tsn_english_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_tsn_english_news +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tsn_english_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tsn_english_news_en_5.4.2_3.0_1724702937565.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tsn_english_news_en_5.4.2_3.0_1724702937565.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_tsn_english_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_tsn_english_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tsn_english_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_tsn_en_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_pipeline_en.md new file mode 100644 index 00000000000000..2f44a8b89cf53b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5_tsn_english_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_tsn_english_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: mt5_tsn_english_news_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tsn_english_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tsn_english_news_pipeline_en_5.4.2_3.0_1724703261608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tsn_english_news_pipeline_en_5.4.2_3.0_1724703261608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_tsn_english_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_tsn_english_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tsn_english_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_tsn_en_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_en.md new file mode 100644 index 00000000000000..0d63e4b99d3111 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5s_bi25150 T5Transformer from NaoS2 +author: John Snow Labs +name: mt5s_bi25150 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5s_bi25150` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5s_bi25150_en_5.4.2_3.0_1724703026455.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5s_bi25150_en_5.4.2_3.0_1724703026455.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5s_bi25150","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5s_bi25150", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5s_bi25150| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/NaoS2/mt5s-bi25150 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_pipeline_en.md new file mode 100644 index 00000000000000..eed3edb3423c96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-mt5s_bi25150_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5s_bi25150_pipeline pipeline T5Transformer from NaoS2 +author: John Snow Labs +name: mt5s_bi25150_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5s_bi25150_pipeline` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5s_bi25150_pipeline_en_5.4.2_3.0_1724703168239.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5s_bi25150_pipeline_en_5.4.2_3.0_1724703168239.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5s_bi25150_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5s_bi25150_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5s_bi25150_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/NaoS2/mt5s-bi25150 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_en.md b/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_en.md new file mode 100644 index 00000000000000..1f8073e06db727 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English newit2en_tonga_tonga_islands_bengali T5Transformer from shm0007 +author: John Snow Labs +name: newit2en_tonga_tonga_islands_bengali +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newit2en_tonga_tonga_islands_bengali` is a English model originally trained by shm0007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newit2en_tonga_tonga_islands_bengali_en_5.4.2_3.0_1724663065243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newit2en_tonga_tonga_islands_bengali_en_5.4.2_3.0_1724663065243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("newit2en_tonga_tonga_islands_bengali","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("newit2en_tonga_tonga_islands_bengali", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newit2en_tonga_tonga_islands_bengali| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.6 MB| + +## References + +https://huggingface.co/shm0007/newit2en-to-bn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_pipeline_en.md new file mode 100644 index 00000000000000..710953b1186d97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newit2en_tonga_tonga_islands_bengali_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English newit2en_tonga_tonga_islands_bengali_pipeline pipeline T5Transformer from shm0007 +author: John Snow Labs +name: newit2en_tonga_tonga_islands_bengali_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newit2en_tonga_tonga_islands_bengali_pipeline` is a English model originally trained by shm0007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newit2en_tonga_tonga_islands_bengali_pipeline_en_5.4.2_3.0_1724663122909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newit2en_tonga_tonga_islands_bengali_pipeline_en_5.4.2_3.0_1724663122909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("newit2en_tonga_tonga_islands_bengali_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("newit2en_tonga_tonga_islands_bengali_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newit2en_tonga_tonga_islands_bengali_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.6 MB| + +## References + +https://huggingface.co/shm0007/newit2en-to-bn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newscreate_en.md b/docs/_posts/ahmedlone127/2024-08-26-newscreate_en.md new file mode 100644 index 00000000000000..64032c2bc0b3d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newscreate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English newscreate T5Transformer from ryota +author: John Snow Labs +name: newscreate +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newscreate` is a English model originally trained by ryota. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newscreate_en_5.4.2_3.0_1724646361181.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newscreate_en_5.4.2_3.0_1724646361181.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("newscreate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("newscreate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newscreate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryota/newsCreate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newscreate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-newscreate_pipeline_en.md new file mode 100644 index 00000000000000..15bbd01d4b0c97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newscreate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English newscreate_pipeline pipeline T5Transformer from ryota +author: John Snow Labs +name: newscreate_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newscreate_pipeline` is a English model originally trained by ryota. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newscreate_pipeline_en_5.4.2_3.0_1724646408953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newscreate_pipeline_en_5.4.2_3.0_1724646408953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("newscreate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("newscreate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newscreate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryota/newsCreate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_en.md b/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_en.md new file mode 100644 index 00000000000000..4e10dc07b3218f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English newssense_article_segmentation T5Transformer from viswavi +author: John Snow Labs +name: newssense_article_segmentation +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newssense_article_segmentation` is a English model originally trained by viswavi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newssense_article_segmentation_en_5.4.2_3.0_1724688144590.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newssense_article_segmentation_en_5.4.2_3.0_1724688144590.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("newssense_article_segmentation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("newssense_article_segmentation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newssense_article_segmentation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/viswavi/newssense_article_segmentation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_pipeline_en.md new file mode 100644 index 00000000000000..b207ffc1c5bd0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-newssense_article_segmentation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English newssense_article_segmentation_pipeline pipeline T5Transformer from viswavi +author: John Snow Labs +name: newssense_article_segmentation_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`newssense_article_segmentation_pipeline` is a English model originally trained by viswavi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/newssense_article_segmentation_pipeline_en_5.4.2_3.0_1724688192592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/newssense_article_segmentation_pipeline_en_5.4.2_3.0_1724688192592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("newssense_article_segmentation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("newssense_article_segmentation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|newssense_article_segmentation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/viswavi/newssense_article_segmentation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_en.md b/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_en.md new file mode 100644 index 00000000000000..0a0000f8cf1c34 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nlpcharade T5Transformer from adit94 +author: John Snow Labs +name: nlpcharade +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nlpcharade` is a English model originally trained by adit94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nlpcharade_en_5.4.2_3.0_1724666927618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nlpcharade_en_5.4.2_3.0_1724666927618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nlpcharade","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nlpcharade", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nlpcharade| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/adit94/nlpcharade \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_pipeline_en.md new file mode 100644 index 00000000000000..dbc157b40edfee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-nlpcharade_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nlpcharade_pipeline pipeline T5Transformer from adit94 +author: John Snow Labs +name: nlpcharade_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nlpcharade_pipeline` is a English model originally trained by adit94. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nlpcharade_pipeline_en_5.4.2_3.0_1724666981506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nlpcharade_pipeline_en_5.4.2_3.0_1724666981506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nlpcharade_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nlpcharade_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nlpcharade_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/adit94/nlpcharade + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..a66cd65d1e2338 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nmt_t5_wmt14_german_tonga_tonga_islands_english T5Transformer from Reyansh4 +author: John Snow Labs +name: nmt_t5_wmt14_german_tonga_tonga_islands_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_t5_wmt14_german_tonga_tonga_islands_english` is a English model originally trained by Reyansh4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_german_tonga_tonga_islands_english_en_5.4.2_3.0_1724675964464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_german_tonga_tonga_islands_english_en_5.4.2_3.0_1724675964464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nmt_t5_wmt14_german_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nmt_t5_wmt14_german_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_t5_wmt14_german_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Reyansh4/NMT_T5_wmt14_de_to_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..2fffb1c4048960 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline pipeline T5Transformer from Reyansh4 +author: John Snow Labs +name: nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline` is a English model originally trained by Reyansh4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724676017658.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724676017658.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_t5_wmt14_german_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Reyansh4/NMT_T5_wmt14_de_to_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..ab633b997d6c82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_normal_graphs_without_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_normal_graphs_without_edge_document_level_t5_run2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_normal_graphs_without_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724686886434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724686886434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_normal_graphs_without_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_normal_graphs_without_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_normal_graphs_without_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_normal_graphs_without_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..d61b97bcc34e98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724686904900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724686904900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_normal_graphs_without_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_en.md b/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_en.md new file mode 100644 index 00000000000000..77743c7a4d47ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normalize_s2t_dataset T5Transformer from ademax +author: John Snow Labs +name: normalize_s2t_dataset +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normalize_s2t_dataset` is a English model originally trained by ademax. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normalize_s2t_dataset_en_5.4.2_3.0_1724696688076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normalize_s2t_dataset_en_5.4.2_3.0_1724696688076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normalize_s2t_dataset","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normalize_s2t_dataset", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normalize_s2t_dataset| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|669.5 MB| + +## References + +https://huggingface.co/ademax/normalize_s2t_dataset \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_pipeline_en.md new file mode 100644 index 00000000000000..a8f8584559ad7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-normalize_s2t_dataset_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normalize_s2t_dataset_pipeline pipeline T5Transformer from ademax +author: John Snow Labs +name: normalize_s2t_dataset_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normalize_s2t_dataset_pipeline` is a English model originally trained by ademax. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normalize_s2t_dataset_pipeline_en_5.4.2_3.0_1724696887667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normalize_s2t_dataset_pipeline_en_5.4.2_3.0_1724696887667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normalize_s2t_dataset_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normalize_s2t_dataset_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normalize_s2t_dataset_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|669.5 MB| + +## References + +https://huggingface.co/ademax/normalize_s2t_dataset + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_or.md b/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_or.md new file mode 100644 index 00000000000000..1e021d6ca677d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_or.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Oriya (macrolanguage) odia_t5_base T5Transformer from mrSoul7766 +author: John Snow Labs +name: odia_t5_base +date: 2024-08-26 +tags: [or, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: or +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`odia_t5_base` is a Oriya (macrolanguage) model originally trained by mrSoul7766. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/odia_t5_base_or_5.4.2_3.0_1724685076077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/odia_t5_base_or_5.4.2_3.0_1724685076077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("odia_t5_base","or") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("odia_t5_base", "or") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|odia_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|or| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mrSoul7766/odia-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_pipeline_or.md b/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_pipeline_or.md new file mode 100644 index 00000000000000..b72f7818c13ae7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-odia_t5_base_pipeline_or.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Oriya (macrolanguage) odia_t5_base_pipeline pipeline T5Transformer from mrSoul7766 +author: John Snow Labs +name: odia_t5_base_pipeline +date: 2024-08-26 +tags: [or, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: or +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`odia_t5_base_pipeline` is a Oriya (macrolanguage) model originally trained by mrSoul7766. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/odia_t5_base_pipeline_or_5.4.2_3.0_1724685171999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/odia_t5_base_pipeline_or_5.4.2_3.0_1724685171999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("odia_t5_base_pipeline", lang = "or") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("odia_t5_base_pipeline", lang = "or") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|odia_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|or| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mrSoul7766/odia-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_en.md b/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_en.md new file mode 100644 index 00000000000000..903ad1b6490434 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v7 T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v7 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v7` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v7_en_5.4.2_3.0_1724690910344.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v7_en_5.4.2_3.0_1724690910344.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("oop_german_qg_flan_t5_base_v7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_pipeline_en.md new file mode 100644 index 00000000000000..7f3eeaeee05978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-oop_german_qg_flan_t5_base_v7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English oop_german_qg_flan_t5_base_v7_pipeline pipeline T5Transformer from LunaticTanuki +author: John Snow Labs +name: oop_german_qg_flan_t5_base_v7_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`oop_german_qg_flan_t5_base_v7_pipeline` is a English model originally trained by LunaticTanuki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v7_pipeline_en_5.4.2_3.0_1724690961507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/oop_german_qg_flan_t5_base_v7_pipeline_en_5.4.2_3.0_1724690961507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("oop_german_qg_flan_t5_base_v7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("oop_german_qg_flan_t5_base_v7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|oop_german_qg_flan_t5_base_v7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LunaticTanuki/oop-de-qg-flan-t5-base-v7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_en.md new file mode 100644 index 00000000000000..170d598101debd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English p5_sports_base T5Transformer from makitanikaze +author: John Snow Labs +name: p5_sports_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`p5_sports_base` is a English model originally trained by makitanikaze. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/p5_sports_base_en_5.4.2_3.0_1724636269486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/p5_sports_base_en_5.4.2_3.0_1724636269486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("p5_sports_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("p5_sports_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|p5_sports_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/makitanikaze/P5_sports_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_pipeline_en.md new file mode 100644 index 00000000000000..b5a1abc2f7400a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-p5_sports_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English p5_sports_base_pipeline pipeline T5Transformer from makitanikaze +author: John Snow Labs +name: p5_sports_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`p5_sports_base_pipeline` is a English model originally trained by makitanikaze. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/p5_sports_base_pipeline_en_5.4.2_3.0_1724636316202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/p5_sports_base_pipeline_en_5.4.2_3.0_1724636316202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("p5_sports_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("p5_sports_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|p5_sports_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/makitanikaze/P5_sports_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_en.md new file mode 100644 index 00000000000000..f93bafa1b22ba7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English paraphraser_german_mt5_small_v2 T5Transformer from milyiyo +author: John Snow Labs +name: paraphraser_german_mt5_small_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paraphraser_german_mt5_small_v2` is a English model originally trained by milyiyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_v2_en_5.4.2_3.0_1724649589254.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_v2_en_5.4.2_3.0_1724649589254.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("paraphraser_german_mt5_small_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("paraphraser_german_mt5_small_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paraphraser_german_mt5_small_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/milyiyo/paraphraser-german-mt5-small-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_pipeline_en.md new file mode 100644 index 00000000000000..91b42fcc8eebbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-paraphraser_german_mt5_small_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English paraphraser_german_mt5_small_v2_pipeline pipeline T5Transformer from milyiyo +author: John Snow Labs +name: paraphraser_german_mt5_small_v2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paraphraser_german_mt5_small_v2_pipeline` is a English model originally trained by milyiyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_v2_pipeline_en_5.4.2_3.0_1724649765890.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_v2_pipeline_en_5.4.2_3.0_1724649765890.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("paraphraser_german_mt5_small_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("paraphraser_german_mt5_small_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paraphraser_german_mt5_small_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/milyiyo/paraphraser-german-mt5-small-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_en.md new file mode 100644 index 00000000000000..c179b678c41938 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English persian3_t5_base T5Transformer from hobab185 +author: John Snow Labs +name: persian3_t5_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`persian3_t5_base` is a English model originally trained by hobab185. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/persian3_t5_base_en_5.4.2_3.0_1724646988057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/persian3_t5_base_en_5.4.2_3.0_1724646988057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("persian3_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("persian3_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|persian3_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|533.6 MB| + +## References + +https://huggingface.co/hobab185/persian3-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..b0d341501458cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-persian3_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English persian3_t5_base_pipeline pipeline T5Transformer from hobab185 +author: John Snow Labs +name: persian3_t5_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`persian3_t5_base_pipeline` is a English model originally trained by hobab185. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/persian3_t5_base_pipeline_en_5.4.2_3.0_1724647165928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/persian3_t5_base_pipeline_en_5.4.2_3.0_1724647165928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("persian3_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("persian3_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|persian3_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|533.6 MB| + +## References + +https://huggingface.co/hobab185/persian3-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_en.md b/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_en.md new file mode 100644 index 00000000000000..e4c9303a4f25c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English plantynet_mt5_kr2en T5Transformer from philnet +author: John Snow Labs +name: plantynet_mt5_kr2en +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`plantynet_mt5_kr2en` is a English model originally trained by philnet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/plantynet_mt5_kr2en_en_5.4.2_3.0_1724633222226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/plantynet_mt5_kr2en_en_5.4.2_3.0_1724633222226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("plantynet_mt5_kr2en","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("plantynet_mt5_kr2en", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|plantynet_mt5_kr2en| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/philnet/plantynet-mt5-kr2en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_pipeline_en.md new file mode 100644 index 00000000000000..ea4239f2f32d0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-plantynet_mt5_kr2en_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English plantynet_mt5_kr2en_pipeline pipeline T5Transformer from philnet +author: John Snow Labs +name: plantynet_mt5_kr2en_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`plantynet_mt5_kr2en_pipeline` is a English model originally trained by philnet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/plantynet_mt5_kr2en_pipeline_en_5.4.2_3.0_1724633281678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/plantynet_mt5_kr2en_pipeline_en_5.4.2_3.0_1724633281678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("plantynet_mt5_kr2en_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("plantynet_mt5_kr2en_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|plantynet_mt5_kr2en_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/philnet/plantynet-mt5-kr2en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_en.md b/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_en.md new file mode 100644 index 00000000000000..5b8fdbdbe2a299 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English poetnet_rut5_stihiru_libru_finetune T5Transformer from dllllb +author: John Snow Labs +name: poetnet_rut5_stihiru_libru_finetune +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`poetnet_rut5_stihiru_libru_finetune` is a English model originally trained by dllllb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/poetnet_rut5_stihiru_libru_finetune_en_5.4.2_3.0_1724679350359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/poetnet_rut5_stihiru_libru_finetune_en_5.4.2_3.0_1724679350359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("poetnet_rut5_stihiru_libru_finetune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("poetnet_rut5_stihiru_libru_finetune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|poetnet_rut5_stihiru_libru_finetune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dllllb/poetnet-rut5-stihiru-libru-finetune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_pipeline_en.md new file mode 100644 index 00000000000000..88e13a7ef965da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-poetnet_rut5_stihiru_libru_finetune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English poetnet_rut5_stihiru_libru_finetune_pipeline pipeline T5Transformer from dllllb +author: John Snow Labs +name: poetnet_rut5_stihiru_libru_finetune_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`poetnet_rut5_stihiru_libru_finetune_pipeline` is a English model originally trained by dllllb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/poetnet_rut5_stihiru_libru_finetune_pipeline_en_5.4.2_3.0_1724679560018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/poetnet_rut5_stihiru_libru_finetune_pipeline_en_5.4.2_3.0_1724679560018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("poetnet_rut5_stihiru_libru_finetune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("poetnet_rut5_stihiru_libru_finetune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|poetnet_rut5_stihiru_libru_finetune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dllllb/poetnet-rut5-stihiru-libru-finetune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pipeline_pl.md b/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pipeline_pl.md new file mode 100644 index 00000000000000..6846dd21dc76db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pipeline_pl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Polish polemma_base_pipeline pipeline T5Transformer from amu-cai +author: John Snow Labs +name: polemma_base_pipeline +date: 2024-08-26 +tags: [pl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polemma_base_pipeline` is a Polish model originally trained by amu-cai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polemma_base_pipeline_pl_5.4.2_3.0_1724662205142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polemma_base_pipeline_pl_5.4.2_3.0_1724662205142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polemma_base_pipeline", lang = "pl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polemma_base_pipeline", lang = "pl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polemma_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|pl| +|Size:|1.1 GB| + +## References + +https://huggingface.co/amu-cai/polemma-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pl.md b/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pl.md new file mode 100644 index 00000000000000..19e21fbee6cc2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-polemma_base_pl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Polish polemma_base T5Transformer from amu-cai +author: John Snow Labs +name: polemma_base +date: 2024-08-26 +tags: [pl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polemma_base` is a Polish model originally trained by amu-cai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polemma_base_pl_5.4.2_3.0_1724662131748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polemma_base_pl_5.4.2_3.0_1724662131748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polemma_base","pl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polemma_base", "pl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polemma_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pl| +|Size:|1.1 GB| + +## References + +https://huggingface.co/amu-cai/polemma-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pipeline_pl.md b/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pipeline_pl.md new file mode 100644 index 00000000000000..c035194d90a15a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pipeline_pl.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Polish polish_denoiser_t5_base_pipeline pipeline T5Transformer from radlab +author: John Snow Labs +name: polish_denoiser_t5_base_pipeline +date: 2024-08-26 +tags: [pl, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_denoiser_t5_base_pipeline` is a Polish model originally trained by radlab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_denoiser_t5_base_pipeline_pl_5.4.2_3.0_1724630474681.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_denoiser_t5_base_pipeline_pl_5.4.2_3.0_1724630474681.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polish_denoiser_t5_base_pipeline", lang = "pl") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polish_denoiser_t5_base_pipeline", lang = "pl") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_denoiser_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|pl| +|Size:|1.2 GB| + +## References + +https://huggingface.co/radlab/polish-denoiser-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pl.md b/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pl.md new file mode 100644 index 00000000000000..f0d191a51b1cd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-polish_denoiser_t5_base_pl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Polish polish_denoiser_t5_base T5Transformer from radlab +author: John Snow Labs +name: polish_denoiser_t5_base +date: 2024-08-26 +tags: [pl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_denoiser_t5_base` is a Polish model originally trained by radlab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_denoiser_t5_base_pl_5.4.2_3.0_1724630418022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_denoiser_t5_base_pl_5.4.2_3.0_1724630418022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polish_denoiser_t5_base","pl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polish_denoiser_t5_base", "pl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_denoiser_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pl| +|Size:|1.2 GB| + +## References + +https://huggingface.co/radlab/polish-denoiser-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_en.md b/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_en.md new file mode 100644 index 00000000000000..0f69466afee76d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pre_trained_t5_small_question_answering T5Transformer from faresfawzi +author: John Snow Labs +name: pre_trained_t5_small_question_answering +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pre_trained_t5_small_question_answering` is a English model originally trained by faresfawzi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pre_trained_t5_small_question_answering_en_5.4.2_3.0_1724683200956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pre_trained_t5_small_question_answering_en_5.4.2_3.0_1724683200956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pre_trained_t5_small_question_answering","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pre_trained_t5_small_question_answering", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pre_trained_t5_small_question_answering| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/faresfawzi/pre_trained_t5-small_question_answering \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_pipeline_en.md new file mode 100644 index 00000000000000..a1e9e420282d5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-pre_trained_t5_small_question_answering_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pre_trained_t5_small_question_answering_pipeline pipeline T5Transformer from faresfawzi +author: John Snow Labs +name: pre_trained_t5_small_question_answering_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pre_trained_t5_small_question_answering_pipeline` is a English model originally trained by faresfawzi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pre_trained_t5_small_question_answering_pipeline_en_5.4.2_3.0_1724683218296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pre_trained_t5_small_question_answering_pipeline_en_5.4.2_3.0_1724683218296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pre_trained_t5_small_question_answering_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pre_trained_t5_small_question_answering_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pre_trained_t5_small_question_answering_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/faresfawzi/pre_trained_t5-small_question_answering + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_en.md b/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_en.md new file mode 100644 index 00000000000000..f463459d5b4a73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptsm_t5_paraphraser T5Transformer from UBC-NLP +author: John Snow Labs +name: ptsm_t5_paraphraser +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptsm_t5_paraphraser` is a English model originally trained by UBC-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptsm_t5_paraphraser_en_5.4.2_3.0_1724713226271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptsm_t5_paraphraser_en_5.4.2_3.0_1724713226271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptsm_t5_paraphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptsm_t5_paraphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptsm_t5_paraphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/UBC-NLP/ptsm_t5_paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_pipeline_en.md new file mode 100644 index 00000000000000..48488e4bce89f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptsm_t5_paraphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptsm_t5_paraphraser_pipeline pipeline T5Transformer from UBC-NLP +author: John Snow Labs +name: ptsm_t5_paraphraser_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptsm_t5_paraphraser_pipeline` is a English model originally trained by UBC-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptsm_t5_paraphraser_pipeline_en_5.4.2_3.0_1724713276304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptsm_t5_paraphraser_pipeline_en_5.4.2_3.0_1724713276304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptsm_t5_paraphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptsm_t5_paraphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptsm_t5_paraphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/UBC-NLP/ptsm_t5_paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pipeline_pt.md b/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pipeline_pt.md new file mode 100644 index 00000000000000..0b143e56d7399d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pipeline_pt.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Portuguese ptt5_base_portuguese_msmarco_100k_v1_pipeline pipeline T5Transformer from unicamp-dl +author: John Snow Labs +name: ptt5_base_portuguese_msmarco_100k_v1_pipeline +date: 2024-08-26 +tags: [pt, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_portuguese_msmarco_100k_v1_pipeline` is a Portuguese model originally trained by unicamp-dl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v1_pipeline_pt_5.4.2_3.0_1724715690865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v1_pipeline_pt_5.4.2_3.0_1724715690865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_base_portuguese_msmarco_100k_v1_pipeline", lang = "pt") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_base_portuguese_msmarco_100k_v1_pipeline", lang = "pt") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_portuguese_msmarco_100k_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|pt| +|Size:|520.4 MB| + +## References + +https://huggingface.co/unicamp-dl/ptt5-base-pt-msmarco-100k-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pt.md b/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pt.md new file mode 100644 index 00000000000000..303dec46bf0801 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptt5_base_portuguese_msmarco_100k_v1_pt.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Portuguese ptt5_base_portuguese_msmarco_100k_v1 T5Transformer from unicamp-dl +author: John Snow Labs +name: ptt5_base_portuguese_msmarco_100k_v1 +date: 2024-08-26 +tags: [pt, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_base_portuguese_msmarco_100k_v1` is a Portuguese model originally trained by unicamp-dl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v1_pt_5.4.2_3.0_1724715509663.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_base_portuguese_msmarco_100k_v1_pt_5.4.2_3.0_1724715509663.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_base_portuguese_msmarco_100k_v1","pt") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_base_portuguese_msmarco_100k_v1", "pt") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_base_portuguese_msmarco_100k_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pt| +|Size:|520.4 MB| + +## References + +https://huggingface.co/unicamp-dl/ptt5-base-pt-msmarco-100k-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_en.md b/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_en.md new file mode 100644 index 00000000000000..48d4027b91849c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_temario T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_temario +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_temario` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_temario_en_5.4.2_3.0_1724685544508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_temario_en_5.4.2_3.0_1724685544508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_temario","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_temario", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_temario| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|975.6 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-temario \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_pipeline_en.md new file mode 100644 index 00000000000000..90f1a89daa3fce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ptt5_temario_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_temario_pipeline pipeline T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_temario_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_temario_pipeline` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_temario_pipeline_en_5.4.2_3.0_1724685599505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_temario_pipeline_en_5.4.2_3.0_1724685599505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_temario_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_temario_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_temario_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|975.6 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-temario + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_en.md b/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_en.md new file mode 100644 index 00000000000000..4ddb4f069caa31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qanom_seq2seq_model_order_invariant T5Transformer from kleinay +author: John Snow Labs +name: qanom_seq2seq_model_order_invariant +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qanom_seq2seq_model_order_invariant` is a English model originally trained by kleinay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qanom_seq2seq_model_order_invariant_en_5.4.2_3.0_1724669467482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qanom_seq2seq_model_order_invariant_en_5.4.2_3.0_1724669467482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qanom_seq2seq_model_order_invariant","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qanom_seq2seq_model_order_invariant", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qanom_seq2seq_model_order_invariant| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.4 MB| + +## References + +https://huggingface.co/kleinay/qanom-seq2seq-model-order-invariant \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_pipeline_en.md new file mode 100644 index 00000000000000..fd749c60460dfb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-qanom_seq2seq_model_order_invariant_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qanom_seq2seq_model_order_invariant_pipeline pipeline T5Transformer from kleinay +author: John Snow Labs +name: qanom_seq2seq_model_order_invariant_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qanom_seq2seq_model_order_invariant_pipeline` is a English model originally trained by kleinay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qanom_seq2seq_model_order_invariant_pipeline_en_5.4.2_3.0_1724669486431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qanom_seq2seq_model_order_invariant_pipeline_en_5.4.2_3.0_1724669486431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qanom_seq2seq_model_order_invariant_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qanom_seq2seq_model_order_invariant_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qanom_seq2seq_model_order_invariant_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.4 MB| + +## References + +https://huggingface.co/kleinay/qanom-seq2seq-model-order-invariant + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_en.md b/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_en.md new file mode 100644 index 00000000000000..10f8e644ae6ef4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English question_gen_naisel T5Transformer from naisel +author: John Snow Labs +name: question_gen_naisel +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_gen_naisel` is a English model originally trained by naisel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_gen_naisel_en_5.4.2_3.0_1724713266096.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_gen_naisel_en_5.4.2_3.0_1724713266096.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("question_gen_naisel","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("question_gen_naisel", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_gen_naisel| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/naisel/Question-gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_pipeline_en.md new file mode 100644 index 00000000000000..7461ad4b2d70dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-question_gen_naisel_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English question_gen_naisel_pipeline pipeline T5Transformer from naisel +author: John Snow Labs +name: question_gen_naisel_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_gen_naisel_pipeline` is a English model originally trained by naisel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_gen_naisel_pipeline_en_5.4.2_3.0_1724713283749.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_gen_naisel_pipeline_en_5.4.2_3.0_1724713283749.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("question_gen_naisel_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("question_gen_naisel_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_gen_naisel_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/naisel/Question-gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rasat_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-rasat_small_en.md new file mode 100644 index 00000000000000..3db9ffccf13a15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rasat_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rasat_small T5Transformer from totem37 +author: John Snow Labs +name: rasat_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rasat_small` is a English model originally trained by totem37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rasat_small_en_5.4.2_3.0_1724678571880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rasat_small_en_5.4.2_3.0_1724678571880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rasat_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rasat_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rasat_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/totem37/RASAT-Small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rasat_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-rasat_small_pipeline_en.md new file mode 100644 index 00000000000000..57201bbe6e949d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rasat_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rasat_small_pipeline pipeline T5Transformer from totem37 +author: John Snow Labs +name: rasat_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rasat_small_pipeline` is a English model originally trained by totem37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rasat_small_pipeline_en_5.4.2_3.0_1724678591255.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rasat_small_pipeline_en_5.4.2_3.0_1724678591255.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rasat_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rasat_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rasat_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/totem37/RASAT-Small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_hu.md b/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_hu.md new file mode 100644 index 00000000000000..b7ff8d65bfaf79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_hu.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Hungarian reading_comprehension_hurc_mt5_hungarian T5Transformer from NYTK +author: John Snow Labs +name: reading_comprehension_hurc_mt5_hungarian +date: 2024-08-26 +tags: [hu, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: hu +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reading_comprehension_hurc_mt5_hungarian` is a Hungarian model originally trained by NYTK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reading_comprehension_hurc_mt5_hungarian_hu_5.4.2_3.0_1724648039217.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reading_comprehension_hurc_mt5_hungarian_hu_5.4.2_3.0_1724648039217.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("reading_comprehension_hurc_mt5_hungarian","hu") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("reading_comprehension_hurc_mt5_hungarian", "hu") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reading_comprehension_hurc_mt5_hungarian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|hu| +|Size:|2.4 GB| + +## References + +https://huggingface.co/NYTK/reading-comprehension-hurc-mt5-hungarian \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_pipeline_hu.md b/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_pipeline_hu.md new file mode 100644 index 00000000000000..3ded94bc85f49b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-reading_comprehension_hurc_mt5_hungarian_pipeline_hu.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Hungarian reading_comprehension_hurc_mt5_hungarian_pipeline pipeline T5Transformer from NYTK +author: John Snow Labs +name: reading_comprehension_hurc_mt5_hungarian_pipeline +date: 2024-08-26 +tags: [hu, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: hu +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reading_comprehension_hurc_mt5_hungarian_pipeline` is a Hungarian model originally trained by NYTK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reading_comprehension_hurc_mt5_hungarian_pipeline_hu_5.4.2_3.0_1724648340675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reading_comprehension_hurc_mt5_hungarian_pipeline_hu_5.4.2_3.0_1724648340675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("reading_comprehension_hurc_mt5_hungarian_pipeline", lang = "hu") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("reading_comprehension_hurc_mt5_hungarian_pipeline", lang = "hu") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reading_comprehension_hurc_mt5_hungarian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|hu| +|Size:|2.4 GB| + +## References + +https://huggingface.co/NYTK/reading-comprehension-hurc-mt5-hungarian + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_en.md new file mode 100644 index 00000000000000..72610b97eb41fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_300_problem_gen_t5_base T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_problem_gen_t5_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_problem_gen_t5_base` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_problem_gen_t5_base_en_5.4.2_3.0_1724695495227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_problem_gen_t5_base_en_5.4.2_3.0_1724695495227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_300_problem_gen_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_300_problem_gen_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_problem_gen_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-problem-gen-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..48bc2b392366d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-real_prompt_300_problem_gen_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English real_prompt_300_problem_gen_t5_base_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_problem_gen_t5_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_problem_gen_t5_base_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_problem_gen_t5_base_pipeline_en_5.4.2_3.0_1724695663383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_problem_gen_t5_base_pipeline_en_5.4.2_3.0_1724695663383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("real_prompt_300_problem_gen_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("real_prompt_300_problem_gen_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_problem_gen_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-problem-gen-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_en.md b/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_en.md new file mode 100644 index 00000000000000..98e00d71656a83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English reinforce_ost T5Transformer from tkuye +author: John Snow Labs +name: reinforce_ost +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reinforce_ost` is a English model originally trained by tkuye. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reinforce_ost_en_5.4.2_3.0_1724687560985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reinforce_ost_en_5.4.2_3.0_1724687560985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("reinforce_ost","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("reinforce_ost", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reinforce_ost| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|989.1 MB| + +## References + +https://huggingface.co/tkuye/reinforce-ost \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_pipeline_en.md new file mode 100644 index 00000000000000..a0899d557ae5e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-reinforce_ost_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English reinforce_ost_pipeline pipeline T5Transformer from tkuye +author: John Snow Labs +name: reinforce_ost_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reinforce_ost_pipeline` is a English model originally trained by tkuye. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reinforce_ost_pipeline_en_5.4.2_3.0_1724687610646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reinforce_ost_pipeline_en_5.4.2_3.0_1724687610646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("reinforce_ost_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("reinforce_ost_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reinforce_ost_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|989.1 MB| + +## References + +https://huggingface.co/tkuye/reinforce-ost + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rel23_conll_en.md b/docs/_posts/ahmedlone127/2024-08-26-rel23_conll_en.md new file mode 100644 index 00000000000000..607e82c3a49a9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rel23_conll_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rel23_conll T5Transformer from sominw +author: John Snow Labs +name: rel23_conll +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rel23_conll` is a English model originally trained by sominw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rel23_conll_en_5.4.2_3.0_1724708517544.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rel23_conll_en_5.4.2_3.0_1724708517544.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rel23_conll","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rel23_conll", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rel23_conll| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sominw/rel23_conll \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rte_en.md b/docs/_posts/ahmedlone127/2024-08-26-rte_en.md new file mode 100644 index 00000000000000..c902efa4ed4dbb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rte_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rte T5Transformer from ShengdingHu +author: John Snow Labs +name: rte +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rte` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rte_en_5.4.2_3.0_1724671725586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rte_en_5.4.2_3.0_1724671725586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rte","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rte", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rte| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/rte \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rte_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-rte_pipeline_en.md new file mode 100644 index 00000000000000..172a15ded187c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rte_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rte_pipeline pipeline T5Transformer from ShengdingHu +author: John Snow Labs +name: rte_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rte_pipeline` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rte_pipeline_en_5.4.2_3.0_1724671782349.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rte_pipeline_en_5.4.2_3.0_1724671782349.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rte_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rte_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rte_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/rte + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_en.md b/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_en.md new file mode 100644 index 00000000000000..99670279c6a56f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rulect_n40_v15_p15 T5Transformer from mika5883 +author: John Snow Labs +name: rulect_n40_v15_p15 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulect_n40_v15_p15` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulect_n40_v15_p15_en_5.4.2_3.0_1724712502993.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulect_n40_v15_p15_en_5.4.2_3.0_1724712502993.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rulect_n40_v15_p15","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rulect_n40_v15_p15", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulect_n40_v15_p15| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULECT_N40_V15_P15 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_pipeline_en.md new file mode 100644 index 00000000000000..4db712922b3bd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rulect_n40_v15_p15_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rulect_n40_v15_p15_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: rulect_n40_v15_p15_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulect_n40_v15_p15_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulect_n40_v15_p15_pipeline_en_5.4.2_3.0_1724712553103.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulect_n40_v15_p15_pipeline_en_5.4.2_3.0_1724712553103.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rulect_n40_v15_p15_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rulect_n40_v15_p15_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulect_n40_v15_p15_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULECT_N40_V15_P15 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_en.md b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_en.md new file mode 100644 index 00000000000000..9c61c501f95e36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_absum_tech_support_calls T5Transformer from abletobetable +author: John Snow Labs +name: rut5_base_absum_tech_support_calls +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_absum_tech_support_calls` is a English model originally trained by abletobetable. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_absum_tech_support_calls_en_5.4.2_3.0_1724694153467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_absum_tech_support_calls_en_5.4.2_3.0_1724694153467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_absum_tech_support_calls","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_absum_tech_support_calls", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_absum_tech_support_calls| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.6 MB| + +## References + +https://huggingface.co/abletobetable/rut5-base-absum-tech-support-calls \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_pipeline_en.md new file mode 100644 index 00000000000000..ffc4563ac75ff3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_absum_tech_support_calls_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_absum_tech_support_calls_pipeline pipeline T5Transformer from abletobetable +author: John Snow Labs +name: rut5_base_absum_tech_support_calls_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_absum_tech_support_calls_pipeline` is a English model originally trained by abletobetable. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_absum_tech_support_calls_pipeline_en_5.4.2_3.0_1724694201886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_absum_tech_support_calls_pipeline_en_5.4.2_3.0_1724694201886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_absum_tech_support_calls_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_absum_tech_support_calls_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_absum_tech_support_calls_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.6 MB| + +## References + +https://huggingface.co/abletobetable/rut5-base-absum-tech-support-calls + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_en.md b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_en.md new file mode 100644 index 00000000000000..b79bfdaa231cec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned_mlsum T5Transformer from Ravencer +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned_mlsum +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned_mlsum` is a English model originally trained by Ravencer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_mlsum_en_5.4.2_3.0_1724654533327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_mlsum_en_5.4.2_3.0_1724654533327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned_mlsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned_mlsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned_mlsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|992.7 MB| + +## References + +https://huggingface.co/Ravencer/rut5_base_sum_gazeta-finetuned-mlsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_pipeline_en.md new file mode 100644 index 00000000000000..83c6d82098402e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-rut5_base_sum_gazeta_finetuned_mlsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned_mlsum_pipeline pipeline T5Transformer from Ravencer +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned_mlsum_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned_mlsum_pipeline` is a English model originally trained by Ravencer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_mlsum_pipeline_en_5.4.2_3.0_1724654585836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_mlsum_pipeline_en_5.4.2_3.0_1724654585836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_sum_gazeta_finetuned_mlsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_sum_gazeta_finetuned_mlsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned_mlsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.7 MB| + +## References + +https://huggingface.co/Ravencer/rut5_base_sum_gazeta-finetuned-mlsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-save_model_en.md b/docs/_posts/ahmedlone127/2024-08-26-save_model_en.md new file mode 100644 index 00000000000000..8a8bcf7d96fe07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-save_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English save_model T5Transformer from Hit918 +author: John Snow Labs +name: save_model +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`save_model` is a English model originally trained by Hit918. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/save_model_en_5.4.2_3.0_1724660699730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/save_model_en_5.4.2_3.0_1724660699730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("save_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("save_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|save_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.5 MB| + +## References + +https://huggingface.co/Hit918/save_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-save_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-save_model_pipeline_en.md new file mode 100644 index 00000000000000..ea60bbba6f620b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-save_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English save_model_pipeline pipeline T5Transformer from Hit918 +author: John Snow Labs +name: save_model_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`save_model_pipeline` is a English model originally trained by Hit918. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/save_model_pipeline_en_5.4.2_3.0_1724660719723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/save_model_pipeline_en_5.4.2_3.0_1724660719723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("save_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("save_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|save_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.5 MB| + +## References + +https://huggingface.co/Hit918/save_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_en.md b/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_en.md new file mode 100644 index 00000000000000..98c8ceccf7eadc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scores_flan_t5_large_16_11 T5Transformer from oscorrea +author: John Snow Labs +name: scores_flan_t5_large_16_11 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scores_flan_t5_large_16_11` is a English model originally trained by oscorrea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_16_11_en_5.4.2_3.0_1724689113646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_16_11_en_5.4.2_3.0_1724689113646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scores_flan_t5_large_16_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scores_flan_t5_large_16_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scores_flan_t5_large_16_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/oscorrea/scores-flan-t5-large-16-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_pipeline_en.md new file mode 100644 index 00000000000000..add4a831df4c21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-scores_flan_t5_large_16_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scores_flan_t5_large_16_11_pipeline pipeline T5Transformer from oscorrea +author: John Snow Labs +name: scores_flan_t5_large_16_11_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scores_flan_t5_large_16_11_pipeline` is a English model originally trained by oscorrea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_16_11_pipeline_en_5.4.2_3.0_1724689253721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_16_11_pipeline_en_5.4.2_3.0_1724689253721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scores_flan_t5_large_16_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scores_flan_t5_large_16_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scores_flan_t5_large_16_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/oscorrea/scores-flan-t5-large-16-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_bn.md b/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_bn.md new file mode 100644 index 00000000000000..636cea0317ba5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_bn.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Bengali semantically_aware_banglat5_for_paraphrase T5Transformer from fuadalhasib +author: John Snow Labs +name: semantically_aware_banglat5_for_paraphrase +date: 2024-08-26 +tags: [bn, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: bn +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`semantically_aware_banglat5_for_paraphrase` is a Bengali model originally trained by fuadalhasib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/semantically_aware_banglat5_for_paraphrase_bn_5.4.2_3.0_1724652458310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/semantically_aware_banglat5_for_paraphrase_bn_5.4.2_3.0_1724652458310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("semantically_aware_banglat5_for_paraphrase","bn") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("semantically_aware_banglat5_for_paraphrase", "bn") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|semantically_aware_banglat5_for_paraphrase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|bn| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fuadalhasib/semantically-aware-banglat5-for-paraphrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_pipeline_bn.md b/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_pipeline_bn.md new file mode 100644 index 00000000000000..02eefe2376969b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-semantically_aware_banglat5_for_paraphrase_pipeline_bn.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Bengali semantically_aware_banglat5_for_paraphrase_pipeline pipeline T5Transformer from fuadalhasib +author: John Snow Labs +name: semantically_aware_banglat5_for_paraphrase_pipeline +date: 2024-08-26 +tags: [bn, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: bn +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`semantically_aware_banglat5_for_paraphrase_pipeline` is a Bengali model originally trained by fuadalhasib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/semantically_aware_banglat5_for_paraphrase_pipeline_bn_5.4.2_3.0_1724652509525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/semantically_aware_banglat5_for_paraphrase_pipeline_bn_5.4.2_3.0_1724652509525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("semantically_aware_banglat5_for_paraphrase_pipeline", lang = "bn") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("semantically_aware_banglat5_for_paraphrase_pipeline", lang = "bn") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|semantically_aware_banglat5_for_paraphrase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|bn| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fuadalhasib/semantically-aware-banglat5-for-paraphrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-sft_en.md b/docs/_posts/ahmedlone127/2024-08-26-sft_en.md new file mode 100644 index 00000000000000..47c39ad8667880 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-sft_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft T5Transformer from Eli-Rhm +author: John Snow Labs +name: sft +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft` is a English model originally trained by Eli-Rhm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_en_5.4.2_3.0_1724636333087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_en_5.4.2_3.0_1724636333087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Eli-Rhm/SFT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-sft_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-sft_pipeline_en.md new file mode 100644 index 00000000000000..eaeb56ff9bd2fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-sft_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_pipeline pipeline T5Transformer from Eli-Rhm +author: John Snow Labs +name: sft_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_pipeline` is a English model originally trained by Eli-Rhm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_pipeline_en_5.4.2_3.0_1724636382404.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_pipeline_en_5.4.2_3.0_1724636382404.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Eli-Rhm/SFT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..3bd0032a89ab78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724666911734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724666911734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.9 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_without_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..21552cce472d23 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724666931486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724666931486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.9 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_without_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..99435a123eb784 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724691059394.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_en_5.4.2_3.0_1724691059394.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_without_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..bdb93f45d44912 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724691078786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724691078786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_without_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..edc8dc81c08aa5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724680082510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724680082510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_without_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..d908b2314d81ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724680101028.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724680101028.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_without_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_en.md b/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_en.md new file mode 100644 index 00000000000000..4e2910a8612d3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English skill_extracting_t5_epoch19 T5Transformer from ManulaPankaja +author: John Snow Labs +name: skill_extracting_t5_epoch19 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`skill_extracting_t5_epoch19` is a English model originally trained by ManulaPankaja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/skill_extracting_t5_epoch19_en_5.4.2_3.0_1724646248634.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/skill_extracting_t5_epoch19_en_5.4.2_3.0_1724646248634.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("skill_extracting_t5_epoch19","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("skill_extracting_t5_epoch19", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|skill_extracting_t5_epoch19| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.4 MB| + +## References + +https://huggingface.co/ManulaPankaja/skill_extracting_t5_epoch19 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_pipeline_en.md new file mode 100644 index 00000000000000..f9a3d077eb2d93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-skill_extracting_t5_epoch19_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English skill_extracting_t5_epoch19_pipeline pipeline T5Transformer from ManulaPankaja +author: John Snow Labs +name: skill_extracting_t5_epoch19_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`skill_extracting_t5_epoch19_pipeline` is a English model originally trained by ManulaPankaja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/skill_extracting_t5_epoch19_pipeline_en_5.4.2_3.0_1724646297724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/skill_extracting_t5_epoch19_pipeline_en_5.4.2_3.0_1724646297724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("skill_extracting_t5_epoch19_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("skill_extracting_t5_epoch19_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|skill_extracting_t5_epoch19_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.4 MB| + +## References + +https://huggingface.co/ManulaPankaja/skill_extracting_t5_epoch19 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_en.md b/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_en.md new file mode 100644 index 00000000000000..55d678e5445d8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English stance_detection_t5 T5Transformer from alex2awesome +author: John Snow Labs +name: stance_detection_t5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`stance_detection_t5` is a English model originally trained by alex2awesome. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/stance_detection_t5_en_5.4.2_3.0_1724712327671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/stance_detection_t5_en_5.4.2_3.0_1724712327671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("stance_detection_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("stance_detection_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|stance_detection_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/alex2awesome/stance-detection-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_pipeline_en.md new file mode 100644 index 00000000000000..0789da19c8452d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-stance_detection_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English stance_detection_t5_pipeline pipeline T5Transformer from alex2awesome +author: John Snow Labs +name: stance_detection_t5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`stance_detection_t5_pipeline` is a English model originally trained by alex2awesome. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/stance_detection_t5_pipeline_en_5.4.2_3.0_1724712378027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/stance_detection_t5_pipeline_en_5.4.2_3.0_1724712378027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("stance_detection_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("stance_detection_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|stance_detection_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/alex2awesome/stance-detection-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_en.md b/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_en.md new file mode 100644 index 00000000000000..faf7fac877e31f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English storri_k2t T5Transformer from leumastai +author: John Snow Labs +name: storri_k2t +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`storri_k2t` is a English model originally trained by leumastai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/storri_k2t_en_5.4.2_3.0_1724672971615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/storri_k2t_en_5.4.2_3.0_1724672971615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("storri_k2t","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("storri_k2t", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|storri_k2t| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/leumastai/storri-k2t \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_pipeline_en.md new file mode 100644 index 00000000000000..395e97da93d07e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-storri_k2t_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English storri_k2t_pipeline pipeline T5Transformer from leumastai +author: John Snow Labs +name: storri_k2t_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`storri_k2t_pipeline` is a English model originally trained by leumastai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/storri_k2t_pipeline_en_5.4.2_3.0_1724672992400.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/storri_k2t_pipeline_en_5.4.2_3.0_1724672992400.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("storri_k2t_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("storri_k2t_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|storri_k2t_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/leumastai/storri-k2t + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_en.md b/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_en.md new file mode 100644 index 00000000000000..da9d776bfd1d6d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English subsec_t5_italo_western T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_italo_western +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_italo_western` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_en_5.4.2_3.0_1724695080997.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_en_5.4.2_3.0_1724695080997.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("subsec_t5_italo_western","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("subsec_t5_italo_western", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_italo_western| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|618.1 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-italo-western \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_pipeline_en.md new file mode 100644 index 00000000000000..da7dec24e77809 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-subsec_t5_italo_western_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English subsec_t5_italo_western_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_italo_western_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_italo_western_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_pipeline_en_5.4.2_3.0_1724695295462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_italo_western_pipeline_en_5.4.2_3.0_1724695295462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("subsec_t5_italo_western_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("subsec_t5_italo_western_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_italo_western_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|618.1 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-italo-western + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_en.md new file mode 100644 index 00000000000000..7b69ba55c58144 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_aic_2015_2017 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_2015_2017 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_2015_2017` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2015_2017_en_5.4.2_3.0_1724656522453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2015_2017_en_5.4.2_3.0_1724656522453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_aic_2015_2017","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_aic_2015_2017", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_2015_2017| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|309.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-2015-2017 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_pipeline_en.md new file mode 100644 index 00000000000000..7f0c87ab616daa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_aic_2015_2017_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_aic_2015_2017_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_2015_2017_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_2015_2017_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2015_2017_pipeline_en_5.4.2_3.0_1724656549506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_2015_2017_pipeline_en_5.4.2_3.0_1724656549506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_aic_2015_2017_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_aic_2015_2017_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_2015_2017_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|309.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-2015-2017 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_en.md new file mode 100644 index 00000000000000..ab9aa3d6b9dbcb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_11 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_11_en_5.4.2_3.0_1724662414651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_11_en_5.4.2_3.0_1724662414651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_pipeline_en.md new file mode 100644 index 00000000000000..dfc6e330face5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2013_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_11_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_11_pipeline_en_5.4.2_3.0_1724662431902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_11_pipeline_en_5.4.2_3.0_1724662431902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_en.md new file mode 100644 index 00000000000000..af9fb45f7f9cff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_3_en_5.4.2_3.0_1724653643482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_3_en_5.4.2_3.0_1724653643482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_pipeline_en.md new file mode 100644 index 00000000000000..88a5aa1c2e90c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2015_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_3_pipeline_en_5.4.2_3.0_1724653659971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_3_pipeline_en_5.4.2_3.0_1724653659971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_en.md new file mode 100644 index 00000000000000..9edcd65f8f9e1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_0 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_0` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_0_en_5.4.2_3.0_1724644760872.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_0_en_5.4.2_3.0_1724644760872.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_pipeline_en.md new file mode 100644 index 00000000000000..a71603f01e60de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_0_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_0_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_0_pipeline_en_5.4.2_3.0_1724644778615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_0_pipeline_en_5.4.2_3.0_1724644778615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_en.md new file mode 100644 index 00000000000000..4bc28f7351fc92 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_11 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_11_en_5.4.2_3.0_1724710048499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_11_en_5.4.2_3.0_1724710048499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_pipeline_en.md new file mode 100644 index 00000000000000..88877a1315a625 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2016_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_11_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_11_pipeline_en_5.4.2_3.0_1724710065225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_11_pipeline_en_5.4.2_3.0_1724710065225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_en.md new file mode 100644 index 00000000000000..c17dbacd9007d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_5 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_5` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_5_en_5.4.2_3.0_1724656887448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_5_en_5.4.2_3.0_1724656887448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_pipeline_en.md new file mode 100644 index 00000000000000..d6154e03cbb7ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_5_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_5_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_5_pipeline_en_5.4.2_3.0_1724656914563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_5_pipeline_en_5.4.2_3.0_1724656914563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_en.md new file mode 100644 index 00000000000000..bada6655061e93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_9 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_9_en_5.4.2_3.0_1724646640058.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_9_en_5.4.2_3.0_1724646640058.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_pipeline_en.md new file mode 100644 index 00000000000000..ba499a4bf1b755 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2017_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_9_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_9_pipeline_en_5.4.2_3.0_1724646656569.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_9_pipeline_en_5.4.2_3.0_1724646656569.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_en.md new file mode 100644 index 00000000000000..977d2cc6326a8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2018_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2018_6 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2018_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_6_en_5.4.2_3.0_1724697893635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_6_en_5.4.2_3.0_1724697893635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2018_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2018_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2018_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2018-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_pipeline_en.md new file mode 100644 index 00000000000000..b99270b78f540b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2018_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2018_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2018_6_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2018_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_6_pipeline_en_5.4.2_3.0_1724697911249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_6_pipeline_en_5.4.2_3.0_1724697911249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2018_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2018_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2018_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2018-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_en.md new file mode 100644 index 00000000000000..be11c5ea863f42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_2_en_5.4.2_3.0_1724682276570.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_2_en_5.4.2_3.0_1724682276570.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_pipeline_en.md new file mode 100644 index 00000000000000..d1395e158454d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_2_pipeline_en_5.4.2_3.0_1724682293690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_2_pipeline_en_5.4.2_3.0_1724682293690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_en.md new file mode 100644 index 00000000000000..a3b770f4f1b514 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_3 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_3_en_5.4.2_3.0_1724670187939.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_3_en_5.4.2_3.0_1724670187939.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_pipeline_en.md new file mode 100644 index 00000000000000..ddc654b9a8cb02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2019_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_3_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_3_pipeline_en_5.4.2_3.0_1724670205331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_3_pipeline_en_5.4.2_3.0_1724670205331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_en.md new file mode 100644 index 00000000000000..abe1823b115dda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_4_en_5.4.2_3.0_1724699257538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_4_en_5.4.2_3.0_1724699257538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_pipeline_en.md new file mode 100644 index 00000000000000..1c5656bd6659de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2020_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_4_pipeline_en_5.4.2_3.0_1724699275080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_4_pipeline_en_5.4.2_3.0_1724699275080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_en.md new file mode 100644 index 00000000000000..0f8ea610b30e8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_6 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_6_en_5.4.2_3.0_1724711630583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_6_en_5.4.2_3.0_1724711630583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_pipeline_en.md new file mode 100644 index 00000000000000..e2b31c4429f0ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_lm_wmt_2021_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_6_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_6_pipeline_en_5.4.2_3.0_1724711648331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_6_pipeline_en_5.4.2_3.0_1724711648331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_en.md new file mode 100644 index 00000000000000..b4bedb87d50b8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_news_sum_combined_years T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_news_sum_combined_years +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_news_sum_combined_years` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_news_sum_combined_years_en_5.4.2_3.0_1724699824555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_news_sum_combined_years_en_5.4.2_3.0_1724699824555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_news_sum_combined_years","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_news_sum_combined_years", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_news_sum_combined_years| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-news_sum-combined_years \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_pipeline_en.md new file mode 100644 index 00000000000000..f9cdbfbb47fd3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_news_sum_combined_years_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_news_sum_combined_years_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_news_sum_combined_years_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_news_sum_combined_years_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_news_sum_combined_years_pipeline_en_5.4.2_3.0_1724699841253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_news_sum_combined_years_pipeline_en_5.4.2_3.0_1724699841253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_news_sum_combined_years_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_news_sum_combined_years_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_news_sum_combined_years_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-news_sum-combined_years + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_en.md new file mode 100644 index 00000000000000..964d6674eee45f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_en_5.4.2_3.0_1724632681077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_en_5.4.2_3.0_1724632681077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_pipeline_en.md new file mode 100644 index 00000000000000..2e0e6b0f7393dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2015_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_pipeline_en_5.4.2_3.0_1724632705820.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_pipeline_en_5.4.2_3.0_1724632705820.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_en.md new file mode 100644 index 00000000000000..ce837fedc2bc67 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_10 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_10_en_5.4.2_3.0_1724697414444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_10_en_5.4.2_3.0_1724697414444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_pipeline_en.md new file mode 100644 index 00000000000000..4701b36f2da6e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2016_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_10_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_10_pipeline_en_5.4.2_3.0_1724697443005.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_10_pipeline_en_5.4.2_3.0_1724697443005.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_en.md new file mode 100644 index 00000000000000..6ad119ac0055a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_4_en_5.4.2_3.0_1724656523953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_4_en_5.4.2_3.0_1724656523953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_pipeline_en.md new file mode 100644 index 00000000000000..c409aa46099463 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2017_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_4_pipeline_en_5.4.2_3.0_1724656553425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_4_pipeline_en_5.4.2_3.0_1724656553425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_en.md new file mode 100644 index 00000000000000..eaa194f9cef1bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_6 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_6_en_5.4.2_3.0_1724652075312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_6_en_5.4.2_3.0_1724652075312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_pipeline_en.md new file mode 100644 index 00000000000000..d54c65d5f0c348 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2018_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_6_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_6_pipeline_en_5.4.2_3.0_1724652102934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_6_pipeline_en_5.4.2_3.0_1724652102934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2018_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2018_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_en.md new file mode 100644 index 00000000000000..a442901bf5d1a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_6 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_6_en_5.4.2_3.0_1724700245713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_6_en_5.4.2_3.0_1724700245713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_pipeline_en.md new file mode 100644 index 00000000000000..9b616c81a5b9a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2019_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_6_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_6_pipeline_en_5.4.2_3.0_1724700275603.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_6_pipeline_en_5.4.2_3.0_1724700275603.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_en.md new file mode 100644 index 00000000000000..c08b00ebfe7e83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_1_en_5.4.2_3.0_1724653381102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_1_en_5.4.2_3.0_1724653381102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_pipeline_en.md new file mode 100644 index 00000000000000..83909c0c682851 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_1_pipeline_en_5.4.2_3.0_1724653410145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_1_pipeline_en_5.4.2_3.0_1724653410145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2020_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2020_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_en.md new file mode 100644 index 00000000000000..89681f0add5322 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_8 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_8_en_5.4.2_3.0_1724683169803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_8_en_5.4.2_3.0_1724683169803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_pipeline_en.md new file mode 100644 index 00000000000000..1d100cbbac924e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_60m_poli_aff_2020_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_8_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_8_pipeline_en_5.4.2_3.0_1724683198646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_8_pipeline_en_5.4.2_3.0_1724683198646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2020_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2020_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_arabic_large_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_arabic_large_en.md new file mode 100644 index 00000000000000..eeff1f83f14a8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_arabic_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_arabic_large T5Transformer from bakrianoo +author: John Snow Labs +name: t5_arabic_large +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_arabic_large` is a English model originally trained by bakrianoo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_arabic_large_en_5.4.2_3.0_1724639207767.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_arabic_large_en_5.4.2_3.0_1724639207767.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_arabic_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_arabic_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_arabic_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/bakrianoo/t5-arabic-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_en.md new file mode 100644 index 00000000000000..4ec91dfac3124b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_arabic_transliteration T5Transformer from olanigan +author: John Snow Labs +name: t5_base_arabic_transliteration +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_arabic_transliteration` is a English model originally trained by olanigan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_arabic_transliteration_en_5.4.2_3.0_1724681011316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_arabic_transliteration_en_5.4.2_3.0_1724681011316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_arabic_transliteration","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_arabic_transliteration", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_arabic_transliteration| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|953.3 MB| + +## References + +https://huggingface.co/olanigan/t5-base-ar-transliteration \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_pipeline_en.md new file mode 100644 index 00000000000000..0ca27a228f4014 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_arabic_transliteration_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_arabic_transliteration_pipeline pipeline T5Transformer from olanigan +author: John Snow Labs +name: t5_base_arabic_transliteration_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_arabic_transliteration_pipeline` is a English model originally trained by olanigan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_arabic_transliteration_pipeline_en_5.4.2_3.0_1724681073764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_arabic_transliteration_pipeline_en_5.4.2_3.0_1724681073764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_arabic_transliteration_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_arabic_transliteration_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_arabic_transliteration_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|953.3 MB| + +## References + +https://huggingface.co/olanigan/t5-base-ar-transliteration + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_en.md new file mode 100644 index 00000000000000..d6cfd018c591b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cfpb T5Transformer from zchowdhury +author: John Snow Labs +name: t5_base_cfpb +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cfpb` is a English model originally trained by zchowdhury. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cfpb_en_5.4.2_3.0_1724655173856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cfpb_en_5.4.2_3.0_1724655173856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cfpb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cfpb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cfpb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/zchowdhury/t5-base-cfpb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_pipeline_en.md new file mode 100644 index 00000000000000..423b2cd7c23a6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cfpb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cfpb_pipeline pipeline T5Transformer from zchowdhury +author: John Snow Labs +name: t5_base_cfpb_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cfpb_pipeline` is a English model originally trained by zchowdhury. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cfpb_pipeline_en_5.4.2_3.0_1724655222564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cfpb_pipeline_en_5.4.2_3.0_1724655222564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cfpb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cfpb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cfpb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/zchowdhury/t5-base-cfpb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_en.md new file mode 100644 index 00000000000000..38a6a4cb13e54e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cnn_fp6_test T5Transformer from valhalla +author: John Snow Labs +name: t5_base_cnn_fp6_test +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnn_fp6_test` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnn_fp6_test_en_5.4.2_3.0_1724712617497.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnn_fp6_test_en_5.4.2_3.0_1724712617497.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cnn_fp6_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cnn_fp6_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnn_fp6_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valhalla/t5-base-cnn-fp6-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_pipeline_en.md new file mode 100644 index 00000000000000..94e6717c28482e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cnn_fp6_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cnn_fp6_test_pipeline pipeline T5Transformer from valhalla +author: John Snow Labs +name: t5_base_cnn_fp6_test_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnn_fp6_test_pipeline` is a English model originally trained by valhalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnn_fp6_test_pipeline_en_5.4.2_3.0_1724712668743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnn_fp6_test_pipeline_en_5.4.2_3.0_1724712668743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cnn_fp6_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cnn_fp6_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnn_fp6_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valhalla/t5-base-cnn-fp6-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_en.md new file mode 100644 index 00000000000000..48ed2c9ddf6bfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_conceptor T5Transformer from flexudy +author: John Snow Labs +name: t5_base_conceptor +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_conceptor` is a English model originally trained by flexudy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_conceptor_en_5.4.2_3.0_1724641901291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_conceptor_en_5.4.2_3.0_1724641901291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_conceptor","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_conceptor", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_conceptor| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/flexudy/t5-base-conceptor \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_pipeline_en.md new file mode 100644 index 00000000000000..f44b25de9d275e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_conceptor_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_conceptor_pipeline pipeline T5Transformer from flexudy +author: John Snow Labs +name: t5_base_conceptor_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_conceptor_pipeline` is a English model originally trained by flexudy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_conceptor_pipeline_en_5.4.2_3.0_1724641947878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_conceptor_pipeline_en_5.4.2_3.0_1724641947878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_conceptor_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_conceptor_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_conceptor_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/flexudy/t5-base-conceptor + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_en.md new file mode 100644 index 00000000000000..329e54d9e1631f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cryptic_crosswords_wordplay T5Transformer from timhk +author: John Snow Labs +name: t5_base_cryptic_crosswords_wordplay +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cryptic_crosswords_wordplay` is a English model originally trained by timhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_wordplay_en_5.4.2_3.0_1724673131605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_wordplay_en_5.4.2_3.0_1724673131605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cryptic_crosswords_wordplay","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cryptic_crosswords_wordplay", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cryptic_crosswords_wordplay| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|972.1 MB| + +## References + +https://huggingface.co/timhk/t5-base_cryptic-crosswords-wordplay \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_pipeline_en.md new file mode 100644 index 00000000000000..a4af37ed37fab7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_cryptic_crosswords_wordplay_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cryptic_crosswords_wordplay_pipeline pipeline T5Transformer from timhk +author: John Snow Labs +name: t5_base_cryptic_crosswords_wordplay_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cryptic_crosswords_wordplay_pipeline` is a English model originally trained by timhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_wordplay_pipeline_en_5.4.2_3.0_1724673189180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cryptic_crosswords_wordplay_pipeline_en_5.4.2_3.0_1724673189180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cryptic_crosswords_wordplay_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cryptic_crosswords_wordplay_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cryptic_crosswords_wordplay_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|972.1 MB| + +## References + +https://huggingface.co/timhk/t5-base_cryptic-crosswords-wordplay + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_en.md new file mode 100644 index 00000000000000..b7d6fcea0441c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_dreambank_generation_emot_emotnn T5Transformer from DReAMy-lib +author: John Snow Labs +name: t5_base_dreambank_generation_emot_emotnn +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dreambank_generation_emot_emotnn` is a English model originally trained by DReAMy-lib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_emotnn_en_5.4.2_3.0_1724672565736.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_emotnn_en_5.4.2_3.0_1724672565736.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_dreambank_generation_emot_emotnn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_dreambank_generation_emot_emotnn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dreambank_generation_emot_emotnn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DReAMy-lib/t5-base-DreamBank-Generation-Emot-EmotNn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_pipeline_en.md new file mode 100644 index 00000000000000..2afd503c5cda9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_dreambank_generation_emot_emotnn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_dreambank_generation_emot_emotnn_pipeline pipeline T5Transformer from DReAMy-lib +author: John Snow Labs +name: t5_base_dreambank_generation_emot_emotnn_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dreambank_generation_emot_emotnn_pipeline` is a English model originally trained by DReAMy-lib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_emotnn_pipeline_en_5.4.2_3.0_1724672613791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_emotnn_pipeline_en_5.4.2_3.0_1724672613791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_dreambank_generation_emot_emotnn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_dreambank_generation_emot_emotnn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dreambank_generation_emot_emotnn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DReAMy-lib/t5-base-DreamBank-Generation-Emot-EmotNn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_en.md new file mode 100644 index 00000000000000..c06c9b44b05d4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_fs0_01_all T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_fs0_01_all +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_fs0_01_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_01_all_en_5.4.2_3.0_1724654963585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_01_all_en_5.4.2_3.0_1724654963585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_fs0_01_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_fs0_01_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_fs0_01_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.8 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_fs0.01-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_pipeline_en.md new file mode 100644 index 00000000000000..b18eb4702b9c1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_extraction_cnndm_fs0_01_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_fs0_01_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_fs0_01_all_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_fs0_01_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_01_all_pipeline_en_5.4.2_3.0_1724655013761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_fs0_01_all_pipeline_en_5.4.2_3.0_1724655013761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_extraction_cnndm_fs0_01_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_extraction_cnndm_fs0_01_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_fs0_01_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.8 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_fs0.01-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_en.md new file mode 100644 index 00000000000000..a5b16a81f2aae9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724693498371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724693498371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-infilling-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..b11d479d8a96fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724693554727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724693554727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.9 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-infilling-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..18dc74eeb2efbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_seed_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_2_en_5.4.2_3.0_1724716166282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_2_en_5.4.2_3.0_1724716166282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..d1c7cc5e038abb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724716230902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724716230902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.8 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..c4deb950d3975b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_32_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_32_finetuned_squad_seed_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_32_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_seed_2_en_5.4.2_3.0_1724652093227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_seed_2_en_5.4.2_3.0_1724652093227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_32_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_32_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_32_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|934.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-32-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..4a97ee5bb1a466 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724652162497.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724652162497.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_32_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|934.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-32-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_en.md new file mode 100644 index 00000000000000..67c84070d776a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724706116951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724706116951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|964.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-512-finetuned-squad-infilling-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..bff8a4308cd3bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724706178339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724706178339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_512_finetuned_squad_infilling_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|964.5 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-512-finetuned-squad-infilling-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_en.md new file mode 100644 index 00000000000000..3c877bdc4ea134 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724650671576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724650671576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|964.2 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-512-finetuned-squad-infilling-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..58e1beaf4c0235 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724650732620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724650732620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_512_finetuned_squad_infilling_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|964.2 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-512-finetuned-squad-infilling-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_en.md new file mode 100644 index 00000000000000..c76b5a70555b49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_seed_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_0_en_5.4.2_3.0_1724650118893.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_0_en_5.4.2_3.0_1724650118893.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|938.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..32a742b58c4c36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724650186680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724650186680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|938.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_en.md new file mode 100644 index 00000000000000..370604c139dfd6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou T5Transformer from j0hngou +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_en_5.4.2_3.0_1724695128971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_en_5.4.2_3.0_1724695128971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/j0hngou/t5-base-finetuned-en-to-fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline_en.md new file mode 100644 index 00000000000000..a9e10b5e10ff28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline pipeline T5Transformer from j0hngou +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline_en_5.4.2_3.0_1724695183165.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline_en_5.4.2_3.0_1724695183165.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_french_j0hngou_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/j0hngou/t5-base-finetuned-en-to-fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_en.md new file mode 100644 index 00000000000000..90a6bb44da5615 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_mnli T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_mnli +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_mnli` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_mnli_en_5.4.2_3.0_1724632382771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_mnli_en_5.4.2_3.0_1724632382771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_mnli","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_mnli", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_mnli| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-mnli \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_pipeline_en.md new file mode 100644 index 00000000000000..c098febd17dcc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_mnli_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_mnli_pipeline pipeline T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_mnli_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_mnli_pipeline` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_mnli_pipeline_en_5.4.2_3.0_1724632436925.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_mnli_pipeline_en_5.4.2_3.0_1724632436925.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_mnli_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_mnli_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_mnli_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-mnli + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_en.md new file mode 100644 index 00000000000000..255b0ca10e7ea0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_qnli_pavanneerudu T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_qnli_pavanneerudu +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_qnli_pavanneerudu` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qnli_pavanneerudu_en_5.4.2_3.0_1724635219491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qnli_pavanneerudu_en_5.4.2_3.0_1724635219491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_qnli_pavanneerudu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_qnli_pavanneerudu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_qnli_pavanneerudu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.8 MB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-qnli \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_pipeline_en.md new file mode 100644 index 00000000000000..5e6f5fd94685b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_finetuned_qnli_pavanneerudu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_qnli_pavanneerudu_pipeline pipeline T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_qnli_pavanneerudu_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_qnli_pavanneerudu_pipeline` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qnli_pavanneerudu_pipeline_en_5.4.2_3.0_1724635280216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qnli_pavanneerudu_pipeline_en_5.4.2_3.0_1724635280216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_qnli_pavanneerudu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_qnli_pavanneerudu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_qnli_pavanneerudu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.9 MB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-qnli + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_en.md new file mode 100644 index 00000000000000..122f6326aad9d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_general_news_french_title_generation T5Transformer from edgolyakova +author: John Snow Labs +name: t5_base_general_news_french_title_generation +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_general_news_french_title_generation` is a English model originally trained by edgolyakova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_general_news_french_title_generation_en_5.4.2_3.0_1724642354219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_general_news_french_title_generation_en_5.4.2_3.0_1724642354219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_general_news_french_title_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_general_news_french_title_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_general_news_french_title_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.4 MB| + +## References + +https://huggingface.co/edgolyakova/t5-base-general-news-fr-title-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_pipeline_en.md new file mode 100644 index 00000000000000..e86605a8b99246 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_general_news_french_title_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_general_news_french_title_generation_pipeline pipeline T5Transformer from edgolyakova +author: John Snow Labs +name: t5_base_general_news_french_title_generation_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_general_news_french_title_generation_pipeline` is a English model originally trained by edgolyakova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_general_news_french_title_generation_pipeline_en_5.4.2_3.0_1724642371840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_general_news_french_title_generation_pipeline_en_5.4.2_3.0_1724642371840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_general_news_french_title_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_general_news_french_title_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_general_news_french_title_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.4 MB| + +## References + +https://huggingface.co/edgolyakova/t5-base-general-news-fr-title-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_ja.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_ja.md new file mode 100644 index 00000000000000..2e8504fe8fa122 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese t5_base_japanese_adapt T5Transformer from sonoisa +author: John Snow Labs +name: t5_base_japanese_adapt +date: 2024-08-26 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_adapt` is a Japanese model originally trained by sonoisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_adapt_ja_5.4.2_3.0_1724631058316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_adapt_ja_5.4.2_3.0_1724631058316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_japanese_adapt","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_japanese_adapt", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_adapt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|520.9 MB| + +## References + +https://huggingface.co/sonoisa/t5-base-japanese-adapt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_pipeline_ja.md new file mode 100644 index 00000000000000..c339c13909370c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_japanese_adapt_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese t5_base_japanese_adapt_pipeline pipeline T5Transformer from sonoisa +author: John Snow Labs +name: t5_base_japanese_adapt_pipeline +date: 2024-08-26 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_japanese_adapt_pipeline` is a Japanese model originally trained by sonoisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_japanese_adapt_pipeline_ja_5.4.2_3.0_1724631238253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_japanese_adapt_pipeline_ja_5.4.2_3.0_1724631238253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_japanese_adapt_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_japanese_adapt_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_japanese_adapt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|520.9 MB| + +## References + +https://huggingface.co/sonoisa/t5-base-japanese-adapt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_en.md new file mode 100644 index 00000000000000..1269b6953d77b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_jmultiwoz_e2e T5Transformer from nu-dialogue +author: John Snow Labs +name: t5_base_jmultiwoz_e2e +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_jmultiwoz_e2e` is a English model originally trained by nu-dialogue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_jmultiwoz_e2e_en_5.4.2_3.0_1724694046503.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_jmultiwoz_e2e_en_5.4.2_3.0_1724694046503.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_jmultiwoz_e2e","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_jmultiwoz_e2e", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_jmultiwoz_e2e| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nu-dialogue/t5-base-jmultiwoz-e2e \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_pipeline_en.md new file mode 100644 index 00000000000000..f257a00636a4e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_jmultiwoz_e2e_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_jmultiwoz_e2e_pipeline pipeline T5Transformer from nu-dialogue +author: John Snow Labs +name: t5_base_jmultiwoz_e2e_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_jmultiwoz_e2e_pipeline` is a English model originally trained by nu-dialogue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_jmultiwoz_e2e_pipeline_en_5.4.2_3.0_1724694095312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_jmultiwoz_e2e_pipeline_en_5.4.2_3.0_1724694095312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_jmultiwoz_e2e_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_jmultiwoz_e2e_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_jmultiwoz_e2e_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/nu-dialogue/t5-base-jmultiwoz-e2e + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_en.md new file mode 100644 index 00000000000000..d407703219c50d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_long_livedoor_news_corpus_udaizin T5Transformer from udaizin +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_udaizin +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_udaizin` is a English model originally trained by udaizin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_udaizin_en_5.4.2_3.0_1724716505459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_udaizin_en_5.4.2_3.0_1724716505459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus_udaizin","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus_udaizin", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_udaizin| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/udaizin/t5-base-long-livedoor-news-corpus \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_pipeline_en.md new file mode 100644 index 00000000000000..abacb7ec857104 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_long_livedoor_news_corpus_udaizin_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_long_livedoor_news_corpus_udaizin_pipeline pipeline T5Transformer from udaizin +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_udaizin_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_udaizin_pipeline` is a English model originally trained by udaizin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_udaizin_pipeline_en_5.4.2_3.0_1724716553722.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_udaizin_pipeline_en_5.4.2_3.0_1724716553722.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_livedoor_news_corpus_udaizin_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_livedoor_news_corpus_udaizin_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_udaizin_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/udaizin/t5-base-long-livedoor-news-corpus + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_en.md new file mode 100644 index 00000000000000..8888674a6ffb6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_make_natural T5Transformer from jaekwanyda +author: John Snow Labs +name: t5_base_make_natural +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_make_natural` is a English model originally trained by jaekwanyda. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_en_5.4.2_3.0_1724711470919.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_en_5.4.2_3.0_1724711470919.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_make_natural","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_make_natural", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_make_natural| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaekwanyda/T5_base_make_natural \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_pipeline_en.md new file mode 100644 index 00000000000000..23b73193e64089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_make_natural_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_make_natural_pipeline pipeline T5Transformer from jaekwanyda +author: John Snow Labs +name: t5_base_make_natural_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_make_natural_pipeline` is a English model originally trained by jaekwanyda. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_pipeline_en_5.4.2_3.0_1724711521235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_make_natural_pipeline_en_5.4.2_3.0_1724711521235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_make_natural_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_make_natural_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_make_natural_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaekwanyda/T5_base_make_natural + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_en.md new file mode 100644 index 00000000000000..a59cae76862a0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_moe_ex16_half_from_ft_dense_with_sort T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex16_half_from_ft_dense_with_sort +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex16_half_from_ft_dense_with_sort` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex16_half_from_ft_dense_with_sort_en_5.4.2_3.0_1724646386207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex16_half_from_ft_dense_with_sort_en_5.4.2_3.0_1724646386207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_moe_ex16_half_from_ft_dense_with_sort","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_moe_ex16_half_from_ft_dense_with_sort", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex16_half_from_ft_dense_with_sort| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex16_half_from_ft_dense_with_sort \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline_en.md new file mode 100644 index 00000000000000..e72f09a93f6fc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline_en_5.4.2_3.0_1724646533396.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline_en_5.4.2_3.0_1724646533396.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex16_half_from_ft_dense_with_sort_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex16_half_from_ft_dense_with_sort + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_en.md new file mode 100644 index 00000000000000..4a9f9e624f5988 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_moe_ex8_half_from_ft_dense T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex8_half_from_ft_dense +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex8_half_from_ft_dense` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_half_from_ft_dense_en_5.4.2_3.0_1724701017407.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_half_from_ft_dense_en_5.4.2_3.0_1724701017407.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_moe_ex8_half_from_ft_dense","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_moe_ex8_half_from_ft_dense", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex8_half_from_ft_dense| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex8_half_from_ft_dense \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_pipeline_en.md new file mode 100644 index 00000000000000..972b7f9881ed26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_moe_ex8_half_from_ft_dense_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_moe_ex8_half_from_ft_dense_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_moe_ex8_half_from_ft_dense_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_moe_ex8_half_from_ft_dense_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724701168566.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_moe_ex8_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724701168566.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_moe_ex8_half_from_ft_dense_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_moe_ex8_half_from_ft_dense_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_moe_ex8_half_from_ft_dense_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_moe_ex8_half_from_ft_dense + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_en.md new file mode 100644 index 00000000000000..b2a6c5f31b7289 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_mpdocvqa T5Transformer from rubentito +author: John Snow Labs +name: t5_base_mpdocvqa +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mpdocvqa` is a English model originally trained by rubentito. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mpdocvqa_en_5.4.2_3.0_1724636583032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mpdocvqa_en_5.4.2_3.0_1724636583032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_mpdocvqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_mpdocvqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mpdocvqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|981.3 MB| + +## References + +https://huggingface.co/rubentito/t5-base-mpdocvqa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_pipeline_en.md new file mode 100644 index 00000000000000..ba13d00710c7f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_mpdocvqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_mpdocvqa_pipeline pipeline T5Transformer from rubentito +author: John Snow Labs +name: t5_base_mpdocvqa_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mpdocvqa_pipeline` is a English model originally trained by rubentito. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mpdocvqa_pipeline_en_5.4.2_3.0_1724636637332.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mpdocvqa_pipeline_en_5.4.2_3.0_1724636637332.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_mpdocvqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_mpdocvqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mpdocvqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|981.3 MB| + +## References + +https://huggingface.co/rubentito/t5-base-mpdocvqa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_pipeline_xx.md new file mode 100644 index 00000000000000..84933b86b40d42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual t5_base_ncc_lm_pipeline pipeline T5Transformer from north +author: John Snow Labs +name: t5_base_ncc_lm_pipeline +date: 2024-08-26 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm_pipeline` is a Multilingual model originally trained by north. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_pipeline_xx_5.4.2_3.0_1724669056665.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_pipeline_xx_5.4.2_3.0_1724669056665.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ncc_lm_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ncc_lm_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|2.9 GB| + +## References + +https://huggingface.co/north/t5_base_NCC_lm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_xx.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_xx.md new file mode 100644 index 00000000000000..56b4b025ab1bc8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ncc_lm_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual t5_base_ncc_lm T5Transformer from north +author: John Snow Labs +name: t5_base_ncc_lm +date: 2024-08-26 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm` is a Multilingual model originally trained by north. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_xx_5.4.2_3.0_1724668907661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_xx_5.4.2_3.0_1724668907661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ncc_lm","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ncc_lm", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|2.9 GB| + +## References + +https://huggingface.co/north/t5_base_NCC_lm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_en.md new file mode 100644 index 00000000000000..3684ab75cf1a41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_ner_mit_restaurant T5Transformer from olgaduchovny +author: John Snow Labs +name: t5_base_ner_mit_restaurant +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ner_mit_restaurant` is a English model originally trained by olgaduchovny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ner_mit_restaurant_en_5.4.2_3.0_1724701043740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ner_mit_restaurant_en_5.4.2_3.0_1724701043740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ner_mit_restaurant","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ner_mit_restaurant", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ner_mit_restaurant| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|994.1 MB| + +## References + +https://huggingface.co/olgaduchovny/t5-base-ner-mit-restaurant \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_pipeline_en.md new file mode 100644 index 00000000000000..85a351cd8128f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_ner_mit_restaurant_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_ner_mit_restaurant_pipeline pipeline T5Transformer from olgaduchovny +author: John Snow Labs +name: t5_base_ner_mit_restaurant_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ner_mit_restaurant_pipeline` is a English model originally trained by olgaduchovny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ner_mit_restaurant_pipeline_en_5.4.2_3.0_1724701097640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ner_mit_restaurant_pipeline_en_5.4.2_3.0_1724701097640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ner_mit_restaurant_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ner_mit_restaurant_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ner_mit_restaurant_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|994.1 MB| + +## References + +https://huggingface.co/olgaduchovny/t5-base-ner-mit-restaurant + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_en.md new file mode 100644 index 00000000000000..7037467eca0179 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_prompter_multiarith_300_repeated_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_multiarith_300_repeated_ep10 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_multiarith_300_repeated_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep10_en_5.4.2_3.0_1724685589012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep10_en_5.4.2_3.0_1724685589012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_prompter_multiarith_300_repeated_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_prompter_multiarith_300_repeated_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_multiarith_300_repeated_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|927.1 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-multiarith_300-repeated-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_pipeline_en.md new file mode 100644 index 00000000000000..a3acbd4f25ccf0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_prompter_multiarith_300_repeated_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_multiarith_300_repeated_ep10_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_multiarith_300_repeated_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep10_pipeline_en_5.4.2_3.0_1724685651273.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep10_pipeline_en_5.4.2_3.0_1724685651273.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_prompter_multiarith_300_repeated_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_prompter_multiarith_300_repeated_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_multiarith_300_repeated_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|927.1 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-multiarith_300-repeated-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_en.md new file mode 100644 index 00000000000000..47275d1f92c73b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_prompter_multiarith_300_repeated_ep2_all T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_multiarith_300_repeated_ep2_all +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_multiarith_300_repeated_ep2_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep2_all_en_5.4.2_3.0_1724642507639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep2_all_en_5.4.2_3.0_1724642507639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_prompter_multiarith_300_repeated_ep2_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_prompter_multiarith_300_repeated_ep2_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_multiarith_300_repeated_ep2_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|924.1 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-multiarith_300-repeated-ep2-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline_en.md new file mode 100644 index 00000000000000..b508348960a460 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline_en_5.4.2_3.0_1724642565460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline_en_5.4.2_3.0_1724642565460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_multiarith_300_repeated_ep2_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|924.1 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-multiarith_300-repeated-ep2-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_en.md new file mode 100644 index 00000000000000..d5bf1bdd0555db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_aap_test T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aap_test +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aap_test` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_test_en_5.4.2_3.0_1724708834873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_test_en_5.4.2_3.0_1724708834873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_aap_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_aap_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aap_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|894.1 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aap-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_pipeline_en.md new file mode 100644 index 00000000000000..350771fd0633e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_aap_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_aap_test_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aap_test_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aap_test_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_test_pipeline_en_5.4.2_3.0_1724708915499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aap_test_pipeline_en_5.4.2_3.0_1724708915499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_aap_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_aap_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aap_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|894.1 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aap-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_en.md new file mode 100644 index 00000000000000..ae1f45b5476030 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_ap_test T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_ap_test +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_ap_test` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_ap_test_en_5.4.2_3.0_1724693856512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_ap_test_en_5.4.2_3.0_1724693856512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_ap_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_ap_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_ap_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|882.8 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-ap-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_pipeline_en.md new file mode 100644 index 00000000000000..54cf0f8c7c8b6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ap_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_ap_test_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_ap_test_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_ap_test_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_ap_test_pipeline_en_5.4.2_3.0_1724693938851.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_ap_test_pipeline_en_5.4.2_3.0_1724693938851.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_ap_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_ap_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_ap_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|882.8 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-ap-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_en.md new file mode 100644 index 00000000000000..e288b29d82ee77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_ctx_a T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_ctx_a +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_ctx_a` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_ctx_a_en_5.4.2_3.0_1724714576461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_ctx_a_en_5.4.2_3.0_1724714576461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_ctx_a","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_ctx_a", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_ctx_a| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.5 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-ctx-a \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_pipeline_en.md new file mode 100644 index 00000000000000..2bc6c54f6a7181 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_qg_ctx_a_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_ctx_a_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_ctx_a_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_ctx_a_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_ctx_a_pipeline_en_5.4.2_3.0_1724714632510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_ctx_a_pipeline_en_5.4.2_3.0_1724714632510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_ctx_a_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_ctx_a_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_ctx_a_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.5 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-ctx-a + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_en.md new file mode 100644 index 00000000000000..9eba6a994e9dcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_all T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_all +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_all` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_all_en_5.4.2_3.0_1724714472006.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_all_en_5.4.2_3.0_1724714472006.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_pipeline_en.md new file mode 100644 index 00000000000000..d141b0982eb310 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_all_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_all_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_all_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_all_pipeline_en_5.4.2_3.0_1724714524025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_all_pipeline_en_5.4.2_3.0_1724714524025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_en.md new file mode 100644 index 00000000000000..4eca7a5c83680e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_grocery T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_grocery +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_grocery` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_grocery_en_5.4.2_3.0_1724653073062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_grocery_en_5.4.2_3.0_1724653073062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_grocery","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_grocery", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_grocery| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.6 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-grocery \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_pipeline_en.md new file mode 100644 index 00000000000000..a7c94f7d3ece69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_rlhf_bm25_grocery_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_grocery_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_grocery_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_grocery_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_grocery_pipeline_en_5.4.2_3.0_1724653131176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_grocery_pipeline_en_5.4.2_3.0_1724653131176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_grocery_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_grocery_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_grocery_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.6 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-grocery + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_en.md new file mode 100644 index 00000000000000..88be83b185d823 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed55 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed55 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed55` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed55_en_5.4.2_3.0_1724709983571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed55_en_5.4.2_3.0_1724709983571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline_en.md new file mode 100644 index 00000000000000..778e12b90ea281 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline_en_5.4.2_3.0_1724710030929.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline_en_5.4.2_3.0_1724710030929.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_en.md new file mode 100644 index 00000000000000..13798ab54dd83b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_electronics T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_electronics +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_electronics` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_electronics_en_5.4.2_3.0_1724671141777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_electronics_en_5.4.2_3.0_1724671141777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_electronics","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_electronics", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_electronics| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-electronics \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_pipeline_en.md new file mode 100644 index 00000000000000..8a95d47d062f8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_electronics_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_electronics_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_electronics_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_electronics_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_electronics_pipeline_en_5.4.2_3.0_1724671196465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_electronics_pipeline_en_5.4.2_3.0_1724671196465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_electronics_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_electronics_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_electronics_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-electronics + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_en.md new file mode 100644 index 00000000000000..d8c5c805e74327 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_hint_beauty T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_hint_beauty +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_hint_beauty` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_hint_beauty_en_5.4.2_3.0_1724647169476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_hint_beauty_en_5.4.2_3.0_1724647169476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_hint_beauty","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_hint_beauty", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_hint_beauty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-hint-beauty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_pipeline_en.md new file mode 100644 index 00000000000000..ad21023f0497df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_sft_hint_beauty_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_hint_beauty_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_hint_beauty_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_hint_beauty_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_hint_beauty_pipeline_en_5.4.2_3.0_1724647233687.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_hint_beauty_pipeline_en_5.4.2_3.0_1724647233687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_hint_beauty_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_hint_beauty_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_hint_beauty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-hint-beauty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_en.md new file mode 100644 index 00000000000000..26296ef1ae5362 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_spanish_english T5Transformer from juancavallotti +author: John Snow Labs +name: t5_base_spanish_english +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_spanish_english` is a English model originally trained by juancavallotti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_spanish_english_en_5.4.2_3.0_1724676133602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_spanish_english_en_5.4.2_3.0_1724676133602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_spanish_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_spanish_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_spanish_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/juancavallotti/t5-base-es-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_pipeline_en.md new file mode 100644 index 00000000000000..623355a0f8a046 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_spanish_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_spanish_english_pipeline pipeline T5Transformer from juancavallotti +author: John Snow Labs +name: t5_base_spanish_english_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_spanish_english_pipeline` is a English model originally trained by juancavallotti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_spanish_english_pipeline_en_5.4.2_3.0_1724676310840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_spanish_english_pipeline_en_5.4.2_3.0_1724676310840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_spanish_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_spanish_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_spanish_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/juancavallotti/t5-base-es-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_en.md new file mode 100644 index 00000000000000..91cd08146969cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_finetuned T5Transformer from vimal52 +author: John Snow Labs +name: t5_base_squad_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_finetuned` is a English model originally trained by vimal52. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_finetuned_en_5.4.2_3.0_1724645462852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_finetuned_en_5.4.2_3.0_1724645462852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vimal52/T5-base-SQUAD-Finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..9d51520f9d2bda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_squad_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_finetuned_pipeline pipeline T5Transformer from vimal52 +author: John Snow Labs +name: t5_base_squad_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_finetuned_pipeline` is a English model originally trained by vimal52. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_finetuned_pipeline_en_5.4.2_3.0_1724645509537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_finetuned_pipeline_en_5.4.2_3.0_1724645509537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vimal52/T5-base-SQUAD-Finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_en.md new file mode 100644 index 00000000000000..25f28b9804fcfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_movies_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_movies_qg +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_movies_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_movies_qg_en_5.4.2_3.0_1724678158538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_movies_qg_en_5.4.2_3.0_1724678158538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_movies_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_movies_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_movies_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-movies-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_pipeline_en.md new file mode 100644 index 00000000000000..7c0ff53bf55f62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_movies_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_movies_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_movies_qg_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_movies_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_movies_qg_pipeline_en_5.4.2_3.0_1724678212391.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_movies_qg_pipeline_en_5.4.2_3.0_1724678212391.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_movies_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_movies_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_movies_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-movies-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_en.md new file mode 100644 index 00000000000000..71abdf911f4d7e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_restaurants_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_restaurants_qg +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_restaurants_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_restaurants_qg_en_5.4.2_3.0_1724675491872.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_restaurants_qg_en_5.4.2_3.0_1724675491872.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_restaurants_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_restaurants_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_restaurants_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-restaurants-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_pipeline_en.md new file mode 100644 index 00000000000000..8c29e2f26f45ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_subjqa_restaurants_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_restaurants_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_restaurants_qg_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_restaurants_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_restaurants_qg_pipeline_en_5.4.2_3.0_1724675540117.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_restaurants_qg_pipeline_en_5.4.2_3.0_1724675540117.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_restaurants_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_restaurants_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_restaurants_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-restaurants-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_en.md new file mode 100644 index 00000000000000..329f1261754910 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_3front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_3front_1body_0rear +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_3front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_0rear_en_5.4.2_3.0_1724705189905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_0rear_en_5.4.2_3.0_1724705189905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_3front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_3front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_3front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-3front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..263a4494d5b224 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_3front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_3front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_3front_1body_0rear_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_3front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_0rear_pipeline_en_5.4.2_3.0_1724705238314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_0rear_pipeline_en_5.4.2_3.0_1724705238314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_3front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_3front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_3front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-3front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_en.md new file mode 100644 index 00000000000000..ad1f76f0403865 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_4front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_4front_1body_0rear +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_4front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_0rear_en_5.4.2_3.0_1724703537081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_0rear_en_5.4.2_3.0_1724703537081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_4front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_4front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_4front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-4front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..52da3c86ff67e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_tedxjp_4front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_4front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_4front_1body_0rear_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_4front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_0rear_pipeline_en_5.4.2_3.0_1724703589619.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_0rear_pipeline_en_5.4.2_3.0_1724703589619.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_4front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_4front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_4front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-4front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_en.md new file mode 100644 index 00000000000000..7ecc23f4c959d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_test T5Transformer from jimypbr +author: John Snow Labs +name: t5_base_test +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_test` is a English model originally trained by jimypbr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_test_en_5.4.2_3.0_1724712906282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_test_en_5.4.2_3.0_1724712906282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|638.4 MB| + +## References + +https://huggingface.co/jimypbr/t5-base-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_pipeline_en.md new file mode 100644 index 00000000000000..22802d9c757834 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_test_pipeline pipeline T5Transformer from jimypbr +author: John Snow Labs +name: t5_base_test_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_test_pipeline` is a English model originally trained by jimypbr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_test_pipeline_en_5.4.2_3.0_1724713099020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_test_pipeline_en_5.4.2_3.0_1724713099020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|638.4 MB| + +## References + +https://huggingface.co/jimypbr/t5-base-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_en.md new file mode 100644 index 00000000000000..a0ddba8a876ef2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_with_title_multi_german_wiki_news_wikinewssum T5Transformer from WikinewsSum +author: John Snow Labs +name: t5_base_with_title_multi_german_wiki_news_wikinewssum +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_german_wiki_news_wikinewssum` is a English model originally trained by WikinewsSum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_german_wiki_news_wikinewssum_en_5.4.2_3.0_1724636094306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_german_wiki_news_wikinewssum_en_5.4.2_3.0_1724636094306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_with_title_multi_german_wiki_news_wikinewssum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_with_title_multi_german_wiki_news_wikinewssum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_german_wiki_news_wikinewssum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.1 MB| + +## References + +https://huggingface.co/WikinewsSum/t5-base-with-title-multi-de-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline_en.md new file mode 100644 index 00000000000000..727327a6a9c993 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline pipeline T5Transformer from WikinewsSum +author: John Snow Labs +name: t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline` is a English model originally trained by WikinewsSum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline_en_5.4.2_3.0_1724636148146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline_en_5.4.2_3.0_1724636148146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_german_wiki_news_wikinewssum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.1 MB| + +## References + +https://huggingface.co/WikinewsSum/t5-base-with-title-multi-de-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_en.md new file mode 100644 index 00000000000000..34e89468ad5ec3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_dialogue_classification_5_kmanaa T5Transformer from kmanaa +author: John Snow Labs +name: t5_dialogue_classification_5_kmanaa +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_classification_5_kmanaa` is a English model originally trained by kmanaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_5_kmanaa_en_5.4.2_3.0_1724667563605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_5_kmanaa_en_5.4.2_3.0_1724667563605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialogue_classification_5_kmanaa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialogue_classification_5_kmanaa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_classification_5_kmanaa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kmanaa/t5-dialogue-classification-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_pipeline_en.md new file mode 100644 index 00000000000000..7163b91fec82dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_classification_5_kmanaa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_dialogue_classification_5_kmanaa_pipeline pipeline T5Transformer from kmanaa +author: John Snow Labs +name: t5_dialogue_classification_5_kmanaa_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_classification_5_kmanaa_pipeline` is a English model originally trained by kmanaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_5_kmanaa_pipeline_en_5.4.2_3.0_1724667609542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_5_kmanaa_pipeline_en_5.4.2_3.0_1724667609542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialogue_classification_5_kmanaa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialogue_classification_5_kmanaa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_classification_5_kmanaa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kmanaa/t5-dialogue-classification-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_pipeline_zh.md new file mode 100644 index 00000000000000..be70ca05649196 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese t5_dialogue_collect_v5_pipeline pipeline T5Transformer from svjack +author: John Snow Labs +name: t5_dialogue_collect_v5_pipeline +date: 2024-08-26 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_collect_v5_pipeline` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_v5_pipeline_zh_5.4.2_3.0_1724676337148.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_v5_pipeline_zh_5.4.2_3.0_1724676337148.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialogue_collect_v5_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialogue_collect_v5_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_collect_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|985.2 MB| + +## References + +https://huggingface.co/svjack/T5-dialogue-collect-v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_zh.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_zh.md new file mode 100644 index 00000000000000..96edbee8b1287d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_collect_v5_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese t5_dialogue_collect_v5 T5Transformer from svjack +author: John Snow Labs +name: t5_dialogue_collect_v5 +date: 2024-08-26 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_collect_v5` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_v5_zh_5.4.2_3.0_1724676287549.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_v5_zh_5.4.2_3.0_1724676287549.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialogue_collect_v5","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialogue_collect_v5", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_collect_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|985.2 MB| + +## References + +https://huggingface.co/svjack/T5-dialogue-collect-v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_en.md new file mode 100644 index 00000000000000..d0511b900233f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_dialogue T5Transformer from jantigny +author: John Snow Labs +name: t5_dialogue +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue` is a English model originally trained by jantigny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_en_5.4.2_3.0_1724662975977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_en_5.4.2_3.0_1724662975977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialogue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialogue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/jantigny/t5-dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_pipeline_en.md new file mode 100644 index 00000000000000..29e03d627ec99a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dialogue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_dialogue_pipeline pipeline T5Transformer from jantigny +author: John Snow Labs +name: t5_dialogue_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_pipeline` is a English model originally trained by jantigny. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_pipeline_en_5.4.2_3.0_1724662993103.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_pipeline_en_5.4.2_3.0_1724662993103.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialogue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialogue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/jantigny/t5-dialogue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_en.md new file mode 100644 index 00000000000000..8bf62380efde99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_dish_name_recognition_auxiliary T5Transformer from Jumpy-pku +author: John Snow Labs +name: t5_dish_name_recognition_auxiliary +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dish_name_recognition_auxiliary` is a English model originally trained by Jumpy-pku. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dish_name_recognition_auxiliary_en_5.4.2_3.0_1724640530505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dish_name_recognition_auxiliary_en_5.4.2_3.0_1724640530505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dish_name_recognition_auxiliary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dish_name_recognition_auxiliary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dish_name_recognition_auxiliary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jumpy-pku/t5-dish-name-recognition-auxiliary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_pipeline_en.md new file mode 100644 index 00000000000000..d44b15a98afaf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_dish_name_recognition_auxiliary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_dish_name_recognition_auxiliary_pipeline pipeline T5Transformer from Jumpy-pku +author: John Snow Labs +name: t5_dish_name_recognition_auxiliary_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dish_name_recognition_auxiliary_pipeline` is a English model originally trained by Jumpy-pku. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dish_name_recognition_auxiliary_pipeline_en_5.4.2_3.0_1724640580672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dish_name_recognition_auxiliary_pipeline_en_5.4.2_3.0_1724640580672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dish_name_recognition_auxiliary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dish_name_recognition_auxiliary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dish_name_recognition_auxiliary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Jumpy-pku/t5-dish-name-recognition-auxiliary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_en.md new file mode 100644 index 00000000000000..2aedbc079adc46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_base_ff12000 T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_ff12000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_ff12000` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_ff12000_en_5.4.2_3.0_1724660141432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_ff12000_en_5.4.2_3.0_1724660141432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_base_ff12000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_base_ff12000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_ff12000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/google/t5-efficient-base-ff12000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_pipeline_en.md new file mode 100644 index 00000000000000..ae254ec1d021c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_ff12000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_base_ff12000_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_ff12000_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_ff12000_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_ff12000_pipeline_en_5.4.2_3.0_1724660523756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_ff12000_pipeline_en_5.4.2_3.0_1724660523756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_base_ff12000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_base_ff12000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_ff12000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/google/t5-efficient-base-ff12000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_en.md new file mode 100644 index 00000000000000..579f458d6ee98f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_base_nl36 T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_nl36 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_nl36` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl36_en_5.4.2_3.0_1724638089411.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl36_en_5.4.2_3.0_1724638089411.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_base_nl36","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_base_nl36", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_nl36| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-base-nl36 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_pipeline_en.md new file mode 100644 index 00000000000000..5e5e17e3040d0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_base_nl36_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_base_nl36_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_nl36_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_nl36_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl36_pipeline_en_5.4.2_3.0_1724638568533.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_nl36_pipeline_en_5.4.2_3.0_1724638568533.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_base_nl36_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_base_nl36_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_nl36_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-base-nl36 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_en.md new file mode 100644 index 00000000000000..6d48a1a5970758 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_large_dl8 T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_dl8 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_dl8` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl8_en_5.4.2_3.0_1724706091276.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl8_en_5.4.2_3.0_1724706091276.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_large_dl8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_dl8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_dl8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-dl8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_pipeline_en.md new file mode 100644 index 00000000000000..bad458c690f68d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_dl8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_large_dl8_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_dl8_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_dl8_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl8_pipeline_en_5.4.2_3.0_1724706433201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_dl8_pipeline_en_5.4.2_3.0_1724706433201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_large_dl8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_large_dl8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_dl8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-dl8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_el6_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_el6_en.md new file mode 100644 index 00000000000000..626dca0b4f8100 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_el6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_large_el6 T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_el6 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_el6` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_el6_en_5.4.2_3.0_1724682181252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_el6_en_5.4.2_3.0_1724682181252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_large_el6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_el6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_el6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-el6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_en.md new file mode 100644 index 00000000000000..066485a83ee55d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_large_kv32 T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_kv32 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_kv32` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_kv32_en_5.4.2_3.0_1724711502448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_kv32_en_5.4.2_3.0_1724711502448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_large_kv32","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_large_kv32", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_kv32| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-kv32 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_pipeline_en.md new file mode 100644 index 00000000000000..9eec061cf206e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_large_kv32_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_large_kv32_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_large_kv32_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_large_kv32_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_large_kv32_pipeline_en_5.4.2_3.0_1724711932745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_large_kv32_pipeline_en_5.4.2_3.0_1724711932745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_large_kv32_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_large_kv32_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_large_kv32_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/google/t5-efficient-large-kv32 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_en.md new file mode 100644 index 00000000000000..755c0ca09536fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_small_turkish T5Transformer from Turkish-NLP +author: John Snow Labs +name: t5_efficient_small_turkish +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_turkish` is a English model originally trained by Turkish-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_turkish_en_5.4.2_3.0_1724636443532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_turkish_en_5.4.2_3.0_1724636443532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_small_turkish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_small_turkish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_turkish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/Turkish-NLP/t5-efficient-small-turkish \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_pipeline_en.md new file mode 100644 index 00000000000000..6774ab6d05105f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_efficient_small_turkish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_small_turkish_pipeline pipeline T5Transformer from Turkish-NLP +author: John Snow Labs +name: t5_efficient_small_turkish_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_turkish_pipeline` is a English model originally trained by Turkish-NLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_turkish_pipeline_en_5.4.2_3.0_1724636558541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_turkish_pipeline_en_5.4.2_3.0_1724636558541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_small_turkish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_small_turkish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_turkish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/Turkish-NLP/t5-efficient-small-turkish + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_en.md new file mode 100644 index 00000000000000..b269feca092f11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ep3_wikians T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep3_wikians +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep3_wikians` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep3_wikians_en_5.4.2_3.0_1724653083277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep3_wikians_en_5.4.2_3.0_1724653083277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ep3_wikians","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ep3_wikians", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep3_wikians| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep3-wikians \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_pipeline_en.md new file mode 100644 index 00000000000000..ab45a6e095c2e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_ep3_wikians_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ep3_wikians_pipeline pipeline T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep3_wikians_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep3_wikians_pipeline` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep3_wikians_pipeline_en_5.4.2_3.0_1724653131223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep3_wikians_pipeline_en_5.4.2_3.0_1724653131223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ep3_wikians_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ep3_wikians_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep3_wikians_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep3-wikians + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_en.md new file mode 100644 index 00000000000000..10ffedecc5438f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_grammar_corruption_edits T5Transformer from juancavallotti +author: John Snow Labs +name: t5_grammar_corruption_edits +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_corruption_edits` is a English model originally trained by juancavallotti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_corruption_edits_en_5.4.2_3.0_1724641690964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_corruption_edits_en_5.4.2_3.0_1724641690964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_grammar_corruption_edits","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_grammar_corruption_edits", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_corruption_edits| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/juancavallotti/t5-grammar-corruption-edits \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_pipeline_en.md new file mode 100644 index 00000000000000..b59d95f49e956d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_grammar_corruption_edits_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_grammar_corruption_edits_pipeline pipeline T5Transformer from juancavallotti +author: John Snow Labs +name: t5_grammar_corruption_edits_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_corruption_edits_pipeline` is a English model originally trained by juancavallotti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_corruption_edits_pipeline_en_5.4.2_3.0_1724641742787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_corruption_edits_pipeline_en_5.4.2_3.0_1724641742787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_grammar_corruption_edits_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_grammar_corruption_edits_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_corruption_edits_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/juancavallotti/t5-grammar-corruption-edits + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_en.md new file mode 100644 index 00000000000000..54b4680b92d03d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_amazon_reviews_multi T5Transformer from thainq107 +author: John Snow Labs +name: t5_large_amazon_reviews_multi +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_amazon_reviews_multi` is a English model originally trained by thainq107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_amazon_reviews_multi_en_5.4.2_3.0_1724669781011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_amazon_reviews_multi_en_5.4.2_3.0_1724669781011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_amazon_reviews_multi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_amazon_reviews_multi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_amazon_reviews_multi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/thainq107/t5-large-amazon-reviews-multi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_pipeline_en.md new file mode 100644 index 00000000000000..e1e79efa2a3259 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_amazon_reviews_multi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_amazon_reviews_multi_pipeline pipeline T5Transformer from thainq107 +author: John Snow Labs +name: t5_large_amazon_reviews_multi_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_amazon_reviews_multi_pipeline` is a English model originally trained by thainq107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_amazon_reviews_multi_pipeline_en_5.4.2_3.0_1724669934744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_amazon_reviews_multi_pipeline_en_5.4.2_3.0_1724669934744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_amazon_reviews_multi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_amazon_reviews_multi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_amazon_reviews_multi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/thainq107/t5-large-amazon-reviews-multi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_en.md new file mode 100644 index 00000000000000..66dc8bc9d98035 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_arxiv_abstract_title T5Transformer from pbmstrk +author: John Snow Labs +name: t5_large_arxiv_abstract_title +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_arxiv_abstract_title` is a English model originally trained by pbmstrk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_abstract_title_en_5.4.2_3.0_1724635589889.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_abstract_title_en_5.4.2_3.0_1724635589889.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_arxiv_abstract_title","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_arxiv_abstract_title", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_arxiv_abstract_title| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pbmstrk/t5-large-arxiv-abstract-title \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_pipeline_en.md new file mode 100644 index 00000000000000..49c33e7f5ac2fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_arxiv_abstract_title_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_arxiv_abstract_title_pipeline pipeline T5Transformer from pbmstrk +author: John Snow Labs +name: t5_large_arxiv_abstract_title_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_arxiv_abstract_title_pipeline` is a English model originally trained by pbmstrk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_abstract_title_pipeline_en_5.4.2_3.0_1724635725738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_abstract_title_pipeline_en_5.4.2_3.0_1724635725738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_arxiv_abstract_title_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_arxiv_abstract_title_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_arxiv_abstract_title_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pbmstrk/t5-large-arxiv-abstract-title + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_en.md new file mode 100644 index 00000000000000..ff0135ec0bdff4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_story_cloze T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_story_cloze +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_story_cloze` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_story_cloze_en_5.4.2_3.0_1724698779080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_story_cloze_en_5.4.2_3.0_1724698779080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_story_cloze","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_story_cloze", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_story_cloze| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-story_cloze \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_pipeline_en.md new file mode 100644 index 00000000000000..d44f4e19e1ef57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_large_story_cloze_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_story_cloze_pipeline pipeline T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_story_cloze_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_story_cloze_pipeline` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_story_cloze_pipeline_en_5.4.2_3.0_1724698935231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_story_cloze_pipeline_en_5.4.2_3.0_1724698935231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_story_cloze_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_story_cloze_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_story_cloze_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-story_cloze + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_pipeline_zh.md new file mode 100644 index 00000000000000..a6aabff3836e86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese t5_mask_completion_pipeline pipeline T5Transformer from Maciel +author: John Snow Labs +name: t5_mask_completion_pipeline +date: 2024-08-26 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_completion_pipeline` is a Chinese model originally trained by Maciel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_completion_pipeline_zh_5.4.2_3.0_1724635562354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_completion_pipeline_zh_5.4.2_3.0_1724635562354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mask_completion_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mask_completion_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_completion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Maciel/T5_Mask_Completion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_zh.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_zh.md new file mode 100644 index 00000000000000..c7ce446c3c8db8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mask_completion_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese t5_mask_completion T5Transformer from Maciel +author: John Snow Labs +name: t5_mask_completion +date: 2024-08-26 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_completion` is a Chinese model originally trained by Maciel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_completion_zh_5.4.2_3.0_1724635498869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_completion_zh_5.4.2_3.0_1724635498869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mask_completion","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mask_completion", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_completion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Maciel/T5_Mask_Completion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_en.md new file mode 100644 index 00000000000000..41988a0faf7f05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_med_tsdae_aug_small T5Transformer from lowem1 +author: John Snow Labs +name: t5_med_tsdae_aug_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_med_tsdae_aug_small` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_med_tsdae_aug_small_en_5.4.2_3.0_1724680760176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_med_tsdae_aug_small_en_5.4.2_3.0_1724680760176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_med_tsdae_aug_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_med_tsdae_aug_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_med_tsdae_aug_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.3 MB| + +## References + +https://huggingface.co/lowem1/t5_med_tsdae_aug-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_pipeline_en.md new file mode 100644 index 00000000000000..c8452d786d3e71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_med_tsdae_aug_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_med_tsdae_aug_small_pipeline pipeline T5Transformer from lowem1 +author: John Snow Labs +name: t5_med_tsdae_aug_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_med_tsdae_aug_small_pipeline` is a English model originally trained by lowem1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_med_tsdae_aug_small_pipeline_en_5.4.2_3.0_1724680782581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_med_tsdae_aug_small_pipeline_en_5.4.2_3.0_1724680782581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_med_tsdae_aug_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_med_tsdae_aug_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_med_tsdae_aug_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.3 MB| + +## References + +https://huggingface.co/lowem1/t5_med_tsdae_aug-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_en.md new file mode 100644 index 00000000000000..0407fe366fb6e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_mengzi_mixed T5Transformer from RAYZ +author: John Snow Labs +name: t5_mengzi_mixed +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mengzi_mixed` is a English model originally trained by RAYZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mengzi_mixed_en_5.4.2_3.0_1724702187591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mengzi_mixed_en_5.4.2_3.0_1724702187591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mengzi_mixed","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mengzi_mixed", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mengzi_mixed| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RAYZ/t5-mengzi-mixed \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_pipeline_en.md new file mode 100644 index 00000000000000..f519b5ded3afee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mengzi_mixed_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_mengzi_mixed_pipeline pipeline T5Transformer from RAYZ +author: John Snow Labs +name: t5_mengzi_mixed_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mengzi_mixed_pipeline` is a English model originally trained by RAYZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mengzi_mixed_pipeline_en_5.4.2_3.0_1724702235444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mengzi_mixed_pipeline_en_5.4.2_3.0_1724702235444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mengzi_mixed_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mengzi_mixed_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mengzi_mixed_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RAYZ/t5-mengzi-mixed + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_en.md new file mode 100644 index 00000000000000..6aa7b9ac4a1577 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_mineai_prototype T5Transformer from Logeswaransr +author: John Snow Labs +name: t5_mineai_prototype +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mineai_prototype` is a English model originally trained by Logeswaransr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mineai_prototype_en_5.4.2_3.0_1724668752598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mineai_prototype_en_5.4.2_3.0_1724668752598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mineai_prototype","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mineai_prototype", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mineai_prototype| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Logeswaransr/T5_MineAI_Prototype \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_pipeline_en.md new file mode 100644 index 00000000000000..22849f7d910dbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mineai_prototype_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_mineai_prototype_pipeline pipeline T5Transformer from Logeswaransr +author: John Snow Labs +name: t5_mineai_prototype_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mineai_prototype_pipeline` is a English model originally trained by Logeswaransr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mineai_prototype_pipeline_en_5.4.2_3.0_1724668802288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mineai_prototype_pipeline_en_5.4.2_3.0_1724668802288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mineai_prototype_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mineai_prototype_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mineai_prototype_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Logeswaransr/T5_MineAI_Prototype + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_en.md new file mode 100644 index 00000000000000..1f9459304bf3a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1st T5Transformer from lingchensanwen +author: John Snow Labs +name: t5_model_1st +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1st` is a English model originally trained by lingchensanwen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1st_en_5.4.2_3.0_1724709050272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1st_en_5.4.2_3.0_1724709050272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1st","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1st", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1st| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lingchensanwen/t5_model_1st \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_pipeline_en.md new file mode 100644 index 00000000000000..4b2b6011c92cc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_model_1st_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1st_pipeline pipeline T5Transformer from lingchensanwen +author: John Snow Labs +name: t5_model_1st_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1st_pipeline` is a English model originally trained by lingchensanwen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1st_pipeline_en_5.4.2_3.0_1724709099253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1st_pipeline_en_5.4.2_3.0_1724709099253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1st_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1st_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1st_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lingchensanwen/t5_model_1st + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_en.md new file mode 100644 index 00000000000000..6c3c4d960f2841 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_akira1608 T5Transformer from akira1608 +author: John Snow Labs +name: t5_model_akira1608 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_akira1608` is a English model originally trained by akira1608. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_akira1608_en_5.4.2_3.0_1724710831487.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_akira1608_en_5.4.2_3.0_1724710831487.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_akira1608","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_akira1608", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_akira1608| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/akira1608/T5-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_pipeline_en.md new file mode 100644 index 00000000000000..f4a54af1df4549 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_model_akira1608_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_akira1608_pipeline pipeline T5Transformer from akira1608 +author: John Snow Labs +name: t5_model_akira1608_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_akira1608_pipeline` is a English model originally trained by akira1608. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_akira1608_pipeline_en_5.4.2_3.0_1724710880194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_akira1608_pipeline_en_5.4.2_3.0_1724710880194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_akira1608_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_akira1608_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_akira1608_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/akira1608/T5-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_lb.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_lb.md new file mode 100644 index 00000000000000..57baf167542855 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_lb.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Letzeburgesch, Luxembourgish t5_mt5_tatoeba_english_luxembourgish T5Transformer from mbarnig +author: John Snow Labs +name: t5_mt5_tatoeba_english_luxembourgish +date: 2024-08-26 +tags: [lb, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: lb +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mt5_tatoeba_english_luxembourgish` is a Letzeburgesch, Luxembourgish model originally trained by mbarnig. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mt5_tatoeba_english_luxembourgish_lb_5.4.2_3.0_1724655326949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mt5_tatoeba_english_luxembourgish_lb_5.4.2_3.0_1724655326949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mt5_tatoeba_english_luxembourgish","lb") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mt5_tatoeba_english_luxembourgish", "lb") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mt5_tatoeba_english_luxembourgish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|lb| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mbarnig/T5-mt5-tatoeba-en-lb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_pipeline_lb.md b/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_pipeline_lb.md new file mode 100644 index 00000000000000..ec4083b69e27a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_mt5_tatoeba_english_luxembourgish_pipeline_lb.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Letzeburgesch, Luxembourgish t5_mt5_tatoeba_english_luxembourgish_pipeline pipeline T5Transformer from mbarnig +author: John Snow Labs +name: t5_mt5_tatoeba_english_luxembourgish_pipeline +date: 2024-08-26 +tags: [lb, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: lb +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mt5_tatoeba_english_luxembourgish_pipeline` is a Letzeburgesch, Luxembourgish model originally trained by mbarnig. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mt5_tatoeba_english_luxembourgish_pipeline_lb_5.4.2_3.0_1724655522345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mt5_tatoeba_english_luxembourgish_pipeline_lb_5.4.2_3.0_1724655522345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mt5_tatoeba_english_luxembourgish_pipeline", lang = "lb") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mt5_tatoeba_english_luxembourgish_pipeline", lang = "lb") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mt5_tatoeba_english_luxembourgish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|lb| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mbarnig/T5-mt5-tatoeba-en-lb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_en.md new file mode 100644 index 00000000000000..d82f435338b0f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_multitask T5Transformer from nc33 +author: John Snow Labs +name: t5_multitask +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multitask` is a English model originally trained by nc33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multitask_en_5.4.2_3.0_1724702324859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multitask_en_5.4.2_3.0_1724702324859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_multitask","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_multitask", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multitask| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|944.7 MB| + +## References + +https://huggingface.co/nc33/T5_multitask \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_pipeline_en.md new file mode 100644 index 00000000000000..5087a3f4318116 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_multitask_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_multitask_pipeline pipeline T5Transformer from nc33 +author: John Snow Labs +name: t5_multitask_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multitask_pipeline` is a English model originally trained by nc33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multitask_pipeline_en_5.4.2_3.0_1724702376952.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multitask_pipeline_en_5.4.2_3.0_1724702376952.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_multitask_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_multitask_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multitask_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|944.7 MB| + +## References + +https://huggingface.co/nc33/T5_multitask + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_en.md new file mode 100644 index 00000000000000..aa2cf10ebc6a7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_paraphrase_paws_msrp_opinosis_finetuned_parasci T5Transformer from domenicrosati +author: John Snow Labs +name: t5_paraphrase_paws_msrp_opinosis_finetuned_parasci +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_paws_msrp_opinosis_finetuned_parasci` is a English model originally trained by domenicrosati. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_en_5.4.2_3.0_1724684765639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_en_5.4.2_3.0_1724684765639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_paraphrase_paws_msrp_opinosis_finetuned_parasci","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_paraphrase_paws_msrp_opinosis_finetuned_parasci", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_paws_msrp_opinosis_finetuned_parasci| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/domenicrosati/t5-paraphrase-paws-msrp-opinosis-finetuned-parasci \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline_en.md new file mode 100644 index 00000000000000..7b41f416536d5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline pipeline T5Transformer from domenicrosati +author: John Snow Labs +name: t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline` is a English model originally trained by domenicrosati. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline_en_5.4.2_3.0_1724684813562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline_en_5.4.2_3.0_1724684813562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_paws_msrp_opinosis_finetuned_parasci_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/domenicrosati/t5-paraphrase-paws-msrp-opinosis-finetuned-parasci + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_en.md new file mode 100644 index 00000000000000..80e17903e857fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_qag_base T5Transformer from vahmohh +author: John Snow Labs +name: t5_qag_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_qag_base` is a English model originally trained by vahmohh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_qag_base_en_5.4.2_3.0_1724651736491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_qag_base_en_5.4.2_3.0_1724651736491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_qag_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_qag_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_qag_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vahmohh/t5-qag-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_pipeline_en.md new file mode 100644 index 00000000000000..4adfd264da6ee4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_qag_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_qag_base_pipeline pipeline T5Transformer from vahmohh +author: John Snow Labs +name: t5_qag_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_qag_base_pipeline` is a English model originally trained by vahmohh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_qag_base_pipeline_en_5.4.2_3.0_1724651786314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_qag_base_pipeline_en_5.4.2_3.0_1724651786314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_qag_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_qag_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_qag_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vahmohh/t5-qag-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_en.md new file mode 100644 index 00000000000000..2372a178bed388 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_jobs T5Transformer from mostafa0841 +author: John Snow Labs +name: t5_recommendation_jobs +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_jobs` is a English model originally trained by mostafa0841. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_en_5.4.2_3.0_1724701974360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_en_5.4.2_3.0_1724701974360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_jobs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_jobs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_jobs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|271.5 MB| + +## References + +https://huggingface.co/mostafa0841/t5_recommendation_jobs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_pipeline_en.md new file mode 100644 index 00000000000000..2d7032eed6f8d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_jobs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_jobs_pipeline pipeline T5Transformer from mostafa0841 +author: John Snow Labs +name: t5_recommendation_jobs_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_jobs_pipeline` is a English model originally trained by mostafa0841. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_pipeline_en_5.4.2_3.0_1724702011505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_jobs_pipeline_en_5.4.2_3.0_1724702011505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_jobs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_jobs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_jobs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|271.5 MB| + +## References + +https://huggingface.co/mostafa0841/t5_recommendation_jobs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_sports_equipment_english_tmukande12_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_sports_equipment_english_tmukande12_en.md new file mode 100644 index 00000000000000..685e993623bbaf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_recommendation_sports_equipment_english_tmukande12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_tmukande12 T5Transformer from tmukande12 +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_tmukande12 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_tmukande12` is a English model originally trained by tmukande12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_tmukande12_en_5.4.2_3.0_1724716747108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_tmukande12_en_5.4.2_3.0_1724716747108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_tmukande12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_tmukande12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_tmukande12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/tmukande12/t5_recommendation_sports_equipment_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_rls2000_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_rls2000_en.md new file mode 100644 index 00000000000000..1b7fff504607ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_rls2000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_rls2000 T5Transformer from marcus2000 +author: John Snow Labs +name: t5_rls2000 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rls2000` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rls2000_en_5.4.2_3.0_1724692570775.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rls2000_en_5.4.2_3.0_1724692570775.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_rls2000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rls2000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rls2000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/marcus2000/T5-RLS2000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_en.md new file mode 100644 index 00000000000000..905a34c42f3344 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_article_timpasc T5Transformer from Timpasc +author: John Snow Labs +name: t5_small_article_timpasc +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_article_timpasc` is a English model originally trained by Timpasc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_article_timpasc_en_5.4.2_3.0_1724673177294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_article_timpasc_en_5.4.2_3.0_1724673177294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_article_timpasc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_article_timpasc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_article_timpasc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Timpasc/t5-small-article \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_pipeline_en.md new file mode 100644 index 00000000000000..1971a9deecddd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_article_timpasc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_article_timpasc_pipeline pipeline T5Transformer from Timpasc +author: John Snow Labs +name: t5_small_article_timpasc_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_article_timpasc_pipeline` is a English model originally trained by Timpasc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_article_timpasc_pipeline_en_5.4.2_3.0_1724673193708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_article_timpasc_pipeline_en_5.4.2_3.0_1724673193708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_article_timpasc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_article_timpasc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_article_timpasc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Timpasc/t5-small-article + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_en.md new file mode 100644 index 00000000000000..8dcb6db9fa5df5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_checkpoint_finetuned_pav1 T5Transformer from Racha009 +author: John Snow Labs +name: t5_small_checkpoint_finetuned_pav1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_checkpoint_finetuned_pav1` is a English model originally trained by Racha009. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_finetuned_pav1_en_5.4.2_3.0_1724702777084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_finetuned_pav1_en_5.4.2_3.0_1724702777084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_checkpoint_finetuned_pav1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_checkpoint_finetuned_pav1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_checkpoint_finetuned_pav1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.3 MB| + +## References + +https://huggingface.co/Racha009/t5-small-checkpoint-finetuned-pav1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_pipeline_en.md new file mode 100644 index 00000000000000..85e27ece2114ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_checkpoint_finetuned_pav1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_checkpoint_finetuned_pav1_pipeline pipeline T5Transformer from Racha009 +author: John Snow Labs +name: t5_small_checkpoint_finetuned_pav1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_checkpoint_finetuned_pav1_pipeline` is a English model originally trained by Racha009. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_finetuned_pav1_pipeline_en_5.4.2_3.0_1724702797631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_finetuned_pav1_pipeline_en_5.4.2_3.0_1724702797631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_checkpoint_finetuned_pav1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_checkpoint_finetuned_pav1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_checkpoint_finetuned_pav1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.3 MB| + +## References + +https://huggingface.co/Racha009/t5-small-checkpoint-finetuned-pav1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_en.md new file mode 100644 index 00000000000000..cc0d6a9dcba932 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_crows_pairs_finetuned_hbrpoi T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_crows_pairs_finetuned_hbrpoi +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_crows_pairs_finetuned_hbrpoi` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_hbrpoi_en_5.4.2_3.0_1724678871072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_hbrpoi_en_5.4.2_3.0_1724678871072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_crows_pairs_finetuned_hbrpoi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_crows_pairs_finetuned_hbrpoi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_crows_pairs_finetuned_hbrpoi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_crows_pairs_finetuned_HBRPOI \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_pipeline_en.md new file mode 100644 index 00000000000000..72500e87d90c04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_crows_pairs_finetuned_hbrpoi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_crows_pairs_finetuned_hbrpoi_pipeline pipeline T5Transformer from henryscheible +author: John Snow Labs +name: t5_small_crows_pairs_finetuned_hbrpoi_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_crows_pairs_finetuned_hbrpoi_pipeline` is a English model originally trained by henryscheible. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_hbrpoi_pipeline_en_5.4.2_3.0_1724678898603.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_crows_pairs_finetuned_hbrpoi_pipeline_en_5.4.2_3.0_1724678898603.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_crows_pairs_finetuned_hbrpoi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_crows_pairs_finetuned_hbrpoi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_crows_pairs_finetuned_hbrpoi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.6 MB| + +## References + +https://huggingface.co/henryscheible/t5-small_crows_pairs_finetuned_HBRPOI + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_en.md new file mode 100644 index 00000000000000..826c1cd059b311 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_eng2bash_custom_v2 T5Transformer from alexsha +author: John Snow Labs +name: t5_small_eng2bash_custom_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eng2bash_custom_v2` is a English model originally trained by alexsha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_custom_v2_en_5.4.2_3.0_1724653848921.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_custom_v2_en_5.4.2_3.0_1724653848921.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_eng2bash_custom_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_eng2bash_custom_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eng2bash_custom_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.6 MB| + +## References + +https://huggingface.co/alexsha/t5-small-ENG2BASH-custom-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_pipeline_en.md new file mode 100644 index 00000000000000..799f2b7c229fef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_eng2bash_custom_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_eng2bash_custom_v2_pipeline pipeline T5Transformer from alexsha +author: John Snow Labs +name: t5_small_eng2bash_custom_v2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eng2bash_custom_v2_pipeline` is a English model originally trained by alexsha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_custom_v2_pipeline_en_5.4.2_3.0_1724653867498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eng2bash_custom_v2_pipeline_en_5.4.2_3.0_1724653867498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_eng2bash_custom_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_eng2bash_custom_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eng2bash_custom_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.6 MB| + +## References + +https://huggingface.co/alexsha/t5-small-ENG2BASH-custom-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..7e2a5c8190a190 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_32_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_32_finetuned_squad_seed_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_32_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_2_en_5.4.2_3.0_1724712578768.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_2_en_5.4.2_3.0_1724712578768.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_32_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_32_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_32_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|294.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-32-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..2e57c682e204bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724712611304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724712611304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_32_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|294.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-32-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_en.md new file mode 100644 index 00000000000000..9ca72e0287c3ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_32_finetuned_squad_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_32_finetuned_squad_seed_4 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_32_finetuned_squad_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_4_en_5.4.2_3.0_1724680088484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_4_en_5.4.2_3.0_1724680088484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_32_finetuned_squad_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_32_finetuned_squad_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_32_finetuned_squad_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|294.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-32-finetuned-squad-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..972ac8541d0976 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724680120100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724680120100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_32_finetuned_squad_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|294.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-32-finetuned-squad-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_en.md new file mode 100644 index 00000000000000..31f043a2ca8c20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian T5Transformer from mriggs +author: John Snow Labs +name: t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724671571425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724671571425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.8 MB| + +## References + +https://huggingface.co/mriggs/t5-small-finetuned-1epoch-opus_books-en-to-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md new file mode 100644 index 00000000000000..2ece430426b287 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline pipeline T5Transformer from mriggs +author: John Snow Labs +name: t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724671589764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724671589764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_1epoch_opus_books_english_tonga_tonga_islands_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.8 MB| + +## References + +https://huggingface.co/mriggs/t5-small-finetuned-1epoch-opus_books-en-to-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_en.md new file mode 100644 index 00000000000000..948097eb18b319 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001 T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_en_5.4.2_3.0_1724679494608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_en_5.4.2_3.0_1724679494608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-lr0.001 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline_en.md new file mode 100644 index 00000000000000..1600965bd349b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline pipeline T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline_en_5.4.2_3.0_1724679566070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline_en_5.4.2_3.0_1724679566070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr0_001_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-lr0.001 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_en.md new file mode 100644 index 00000000000000..cb5372a098709b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov T5Transformer from danielbispov +author: John Snow Labs +name: t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov` is a English model originally trained by danielbispov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_en_5.4.2_3.0_1724655197959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_en_5.4.2_3.0_1724655197959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.8 MB| + +## References + +https://huggingface.co/danielbispov/t5-small-finetuned-fi-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline_en.md new file mode 100644 index 00000000000000..18f4214d5b916e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline pipeline T5Transformer from danielbispov +author: John Snow Labs +name: t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline` is a English model originally trained by danielbispov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline_en_5.4.2_3.0_1724655215721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline_en_5.4.2_3.0_1724655215721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_finnish_tonga_tonga_islands_english_danielbispov_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.8 MB| + +## References + +https://huggingface.co/danielbispov/t5-small-finetuned-fi-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_en.md new file mode 100644 index 00000000000000..36d68435cdab62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_german_english_256_wd_01 T5Transformer from rossanez +author: John Snow Labs +name: t5_small_finetuned_german_english_256_wd_01 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_english_256_wd_01` is a English model originally trained by rossanez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_english_256_wd_01_en_5.4.2_3.0_1724656511420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_english_256_wd_01_en_5.4.2_3.0_1724656511420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_german_english_256_wd_01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_german_english_256_wd_01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_english_256_wd_01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.7 MB| + +## References + +https://huggingface.co/rossanez/t5-small-finetuned-de-en-256-wd-01 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_pipeline_en.md new file mode 100644 index 00000000000000..0be0f5eccb42cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_german_english_256_wd_01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_german_english_256_wd_01_pipeline pipeline T5Transformer from rossanez +author: John Snow Labs +name: t5_small_finetuned_german_english_256_wd_01_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_english_256_wd_01_pipeline` is a English model originally trained by rossanez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_english_256_wd_01_pipeline_en_5.4.2_3.0_1724656529549.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_english_256_wd_01_pipeline_en_5.4.2_3.0_1724656529549.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_german_english_256_wd_01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_german_english_256_wd_01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_english_256_wd_01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.7 MB| + +## References + +https://huggingface.co/rossanez/t5-small-finetuned-de-en-256-wd-01 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_en.md new file mode 100644 index 00000000000000..a05ef6e1e95d56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_labels_tonga_tonga_islands_caption T5Transformer from doraemon1998 +author: John Snow Labs +name: t5_small_finetuned_labels_tonga_tonga_islands_caption +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_labels_tonga_tonga_islands_caption` is a English model originally trained by doraemon1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_labels_tonga_tonga_islands_caption_en_5.4.2_3.0_1724709917467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_labels_tonga_tonga_islands_caption_en_5.4.2_3.0_1724709917467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_labels_tonga_tonga_islands_caption","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_labels_tonga_tonga_islands_caption", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_labels_tonga_tonga_islands_caption| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/doraemon1998/t5-small-finetuned-labels-to-caption \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline_en.md new file mode 100644 index 00000000000000..78341690e81abc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline pipeline T5Transformer from doraemon1998 +author: John Snow Labs +name: t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline` is a English model originally trained by doraemon1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline_en_5.4.2_3.0_1724709934931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline_en_5.4.2_3.0_1724709934931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_labels_tonga_tonga_islands_caption_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/doraemon1998/t5-small-finetuned-labels-to-caption + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_en.md new file mode 100644 index 00000000000000..68cbe6b606625e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_wikisql_mrinmoysaikia T5Transformer from MrinmoySaikia +author: John Snow Labs +name: t5_small_finetuned_wikisql_mrinmoysaikia +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_wikisql_mrinmoysaikia` is a English model originally trained by MrinmoySaikia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_wikisql_mrinmoysaikia_en_5.4.2_3.0_1724660825894.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_wikisql_mrinmoysaikia_en_5.4.2_3.0_1724660825894.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_wikisql_mrinmoysaikia","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_wikisql_mrinmoysaikia", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_wikisql_mrinmoysaikia| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.3 MB| + +## References + +https://huggingface.co/MrinmoySaikia/t5-small-finetuned-wikisql \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_pipeline_en.md new file mode 100644 index 00000000000000..1c75090f452089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_wikisql_mrinmoysaikia_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_wikisql_mrinmoysaikia_pipeline pipeline T5Transformer from MrinmoySaikia +author: John Snow Labs +name: t5_small_finetuned_wikisql_mrinmoysaikia_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_wikisql_mrinmoysaikia_pipeline` is a English model originally trained by MrinmoySaikia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_wikisql_mrinmoysaikia_pipeline_en_5.4.2_3.0_1724660844892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_wikisql_mrinmoysaikia_pipeline_en_5.4.2_3.0_1724660844892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_wikisql_mrinmoysaikia_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_wikisql_mrinmoysaikia_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_wikisql_mrinmoysaikia_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.3 MB| + +## References + +https://huggingface.co/MrinmoySaikia/t5-small-finetuned-wikisql + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_en.md new file mode 100644 index 00000000000000..7722f9774e6736 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_harveybro T5Transformer from harveybro +author: John Snow Labs +name: t5_small_finetuned_xsum_harveybro +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_harveybro` is a English model originally trained by harveybro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harveybro_en_5.4.2_3.0_1724697132279.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harveybro_en_5.4.2_3.0_1724697132279.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_harveybro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_harveybro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_harveybro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/harveybro/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_pipeline_en.md new file mode 100644 index 00000000000000..92ca1ef33a53de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_harveybro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_harveybro_pipeline pipeline T5Transformer from harveybro +author: John Snow Labs +name: t5_small_finetuned_xsum_harveybro_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_harveybro_pipeline` is a English model originally trained by harveybro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harveybro_pipeline_en_5.4.2_3.0_1724697150293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harveybro_pipeline_en_5.4.2_3.0_1724697150293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_harveybro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_harveybro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_harveybro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/harveybro/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_en.md new file mode 100644 index 00000000000000..521973a7482b80 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_hchang T5Transformer from hchang +author: John Snow Labs +name: t5_small_finetuned_xsum_hchang +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_hchang` is a English model originally trained by hchang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_hchang_en_5.4.2_3.0_1724670187935.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_hchang_en_5.4.2_3.0_1724670187935.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_hchang","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_hchang", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_hchang| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/hchang/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_pipeline_en.md new file mode 100644 index 00000000000000..95e96944b64a36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_hchang_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_hchang_pipeline pipeline T5Transformer from hchang +author: John Snow Labs +name: t5_small_finetuned_xsum_hchang_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_hchang_pipeline` is a English model originally trained by hchang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_hchang_pipeline_en_5.4.2_3.0_1724670205664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_hchang_pipeline_en_5.4.2_3.0_1724670205664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_hchang_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_hchang_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_hchang_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/hchang/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_en.md new file mode 100644 index 00000000000000..89cd4de8a8b74b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sbulut T5Transformer from sbulut +author: John Snow Labs +name: t5_small_finetuned_xsum_sbulut +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sbulut` is a English model originally trained by sbulut. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sbulut_en_5.4.2_3.0_1724701818977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sbulut_en_5.4.2_3.0_1724701818977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sbulut","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sbulut", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sbulut| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/sbulut/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_pipeline_en.md new file mode 100644 index 00000000000000..2470a1e4f71266 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sbulut_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sbulut_pipeline pipeline T5Transformer from sbulut +author: John Snow Labs +name: t5_small_finetuned_xsum_sbulut_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sbulut_pipeline` is a English model originally trained by sbulut. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sbulut_pipeline_en_5.4.2_3.0_1724701837971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sbulut_pipeline_en_5.4.2_3.0_1724701837971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_sbulut_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_sbulut_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sbulut_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/sbulut/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_en.md new file mode 100644 index 00000000000000..95bf379fc5a41a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sekiyukio T5Transformer from sekiyukio +author: John Snow Labs +name: t5_small_finetuned_xsum_sekiyukio +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sekiyukio` is a English model originally trained by sekiyukio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sekiyukio_en_5.4.2_3.0_1724680645432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sekiyukio_en_5.4.2_3.0_1724680645432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sekiyukio","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_sekiyukio", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sekiyukio| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.2 MB| + +## References + +https://huggingface.co/sekiyukio/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_pipeline_en.md new file mode 100644 index 00000000000000..b846727efde346 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_finetuned_xsum_sekiyukio_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_sekiyukio_pipeline pipeline T5Transformer from sekiyukio +author: John Snow Labs +name: t5_small_finetuned_xsum_sekiyukio_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_sekiyukio_pipeline` is a English model originally trained by sekiyukio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sekiyukio_pipeline_en_5.4.2_3.0_1724680664601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_sekiyukio_pipeline_en_5.4.2_3.0_1724680664601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_sekiyukio_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_sekiyukio_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_sekiyukio_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.2 MB| + +## References + +https://huggingface.co/sekiyukio/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_en.md new file mode 100644 index 00000000000000..57370f2c6090fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_newsqa_qag_finetuned T5Transformer from StellarMilk +author: John Snow Labs +name: t5_small_newsqa_qag_finetuned +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_newsqa_qag_finetuned` is a English model originally trained by StellarMilk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_qag_finetuned_en_5.4.2_3.0_1724680934637.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_qag_finetuned_en_5.4.2_3.0_1724680934637.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_newsqa_qag_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_newsqa_qag_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_newsqa_qag_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/StellarMilk/t5-small-newsqa-qag-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..6b7e40f64e7afa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_newsqa_qag_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_newsqa_qag_finetuned_pipeline pipeline T5Transformer from StellarMilk +author: John Snow Labs +name: t5_small_newsqa_qag_finetuned_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_newsqa_qag_finetuned_pipeline` is a English model originally trained by StellarMilk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_qag_finetuned_pipeline_en_5.4.2_3.0_1724680951405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_newsqa_qag_finetuned_pipeline_en_5.4.2_3.0_1724680951405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_newsqa_qag_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_newsqa_qag_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_newsqa_qag_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/StellarMilk/t5-small-newsqa-qag-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_en.md new file mode 100644 index 00000000000000..23bc1c02df7b76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_pointer_adv_mtop T5Transformer from WillHeld +author: John Snow Labs +name: t5_small_pointer_adv_mtop +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_pointer_adv_mtop` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_pointer_adv_mtop_en_5.4.2_3.0_1724690696147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_pointer_adv_mtop_en_5.4.2_3.0_1724690696147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_pointer_adv_mtop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_pointer_adv_mtop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_pointer_adv_mtop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/WillHeld/t5-small-pointer-adv-mtop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_pipeline_en.md new file mode 100644 index 00000000000000..9f95f9abafc465 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_pointer_adv_mtop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_pointer_adv_mtop_pipeline pipeline T5Transformer from WillHeld +author: John Snow Labs +name: t5_small_pointer_adv_mtop_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_pointer_adv_mtop_pipeline` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_pointer_adv_mtop_pipeline_en_5.4.2_3.0_1724690887260.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_pointer_adv_mtop_pipeline_en_5.4.2_3.0_1724690887260.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_pointer_adv_mtop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_pointer_adv_mtop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_pointer_adv_mtop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/WillHeld/t5-small-pointer-adv-mtop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_en.md new file mode 100644 index 00000000000000..ba5cbecfee1e30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_readme_summarization T5Transformer from bunbohue +author: John Snow Labs +name: t5_small_readme_summarization +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_readme_summarization` is a English model originally trained by bunbohue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_readme_summarization_en_5.4.2_3.0_1724706931045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_readme_summarization_en_5.4.2_3.0_1724706931045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_readme_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_readme_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_readme_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/bunbohue/t5-small_readme_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_pipeline_en.md new file mode 100644 index 00000000000000..9df05b291ef8c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_readme_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_readme_summarization_pipeline pipeline T5Transformer from bunbohue +author: John Snow Labs +name: t5_small_readme_summarization_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_readme_summarization_pipeline` is a English model originally trained by bunbohue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_readme_summarization_pipeline_en_5.4.2_3.0_1724706950526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_readme_summarization_pipeline_en_5.4.2_3.0_1724706950526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_readme_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_readme_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_readme_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/bunbohue/t5-small_readme_summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_en.md new file mode 100644 index 00000000000000..1c8897675e58d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_samsum_kyjac T5Transformer from Kyjac +author: John Snow Labs +name: t5_small_samsum_kyjac +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_samsum_kyjac` is a English model originally trained by Kyjac. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_samsum_kyjac_en_5.4.2_3.0_1724644427450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_samsum_kyjac_en_5.4.2_3.0_1724644427450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_samsum_kyjac","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_samsum_kyjac", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_samsum_kyjac| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.5 MB| + +## References + +https://huggingface.co/Kyjac/t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_pipeline_en.md new file mode 100644 index 00000000000000..ab0918eb562f3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_samsum_kyjac_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_samsum_kyjac_pipeline pipeline T5Transformer from Kyjac +author: John Snow Labs +name: t5_small_samsum_kyjac_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_samsum_kyjac_pipeline` is a English model originally trained by Kyjac. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_samsum_kyjac_pipeline_en_5.4.2_3.0_1724644447037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_samsum_kyjac_pipeline_en_5.4.2_3.0_1724644447037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_samsum_kyjac_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_samsum_kyjac_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_samsum_kyjac_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.5 MB| + +## References + +https://huggingface.co/Kyjac/t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_en.md new file mode 100644 index 00000000000000..dd30cb7c0afec9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_qag T5Transformer from lmqg +author: John Snow Labs +name: t5_small_squad_qag +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qag` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qag_en_5.4.2_3.0_1724630501267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qag_en_5.4.2_3.0_1724630501267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_qag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_qag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/lmqg/t5-small-squad-qag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_pipeline_en.md new file mode 100644 index 00000000000000..76642ba3b35c77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qag_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qag_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_small_squad_qag_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qag_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qag_pipeline_en_5.4.2_3.0_1724630518778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qag_pipeline_en_5.4.2_3.0_1724630518778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qag_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qag_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/lmqg/t5-small-squad-qag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_en.md new file mode 100644 index 00000000000000..9b1a46d1c59b47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_qg_mohammedaly22 T5Transformer from mohammedaly22 +author: John Snow Labs +name: t5_small_squad_qg_mohammedaly22 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_mohammedaly22` is a English model originally trained by mohammedaly22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_mohammedaly22_en_5.4.2_3.0_1724634711223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_mohammedaly22_en_5.4.2_3.0_1724634711223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_qg_mohammedaly22","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_qg_mohammedaly22", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_mohammedaly22| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mohammedaly22/t5-small-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_pipeline_en.md new file mode 100644 index 00000000000000..2db0fe8384a255 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_mohammedaly22_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qg_mohammedaly22_pipeline pipeline T5Transformer from mohammedaly22 +author: John Snow Labs +name: t5_small_squad_qg_mohammedaly22_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_mohammedaly22_pipeline` is a English model originally trained by mohammedaly22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_mohammedaly22_pipeline_en_5.4.2_3.0_1724634729992.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_mohammedaly22_pipeline_en_5.4.2_3.0_1724634729992.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qg_mohammedaly22_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qg_mohammedaly22_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_mohammedaly22_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mohammedaly22/t5-small-squad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_en.md new file mode 100644 index 00000000000000..4b2b1d720b7a77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_qg_norwegian_answer T5Transformer from research-backup +author: John Snow Labs +name: t5_small_squad_qg_norwegian_answer +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_norwegian_answer` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_norwegian_answer_en_5.4.2_3.0_1724674920908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_norwegian_answer_en_5.4.2_3.0_1724674920908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_qg_norwegian_answer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_qg_norwegian_answer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_norwegian_answer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-squad-qg-no-answer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_pipeline_en.md new file mode 100644 index 00000000000000..47c9a2213baf78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_squad_qg_norwegian_answer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qg_norwegian_answer_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_small_squad_qg_norwegian_answer_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_norwegian_answer_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_norwegian_answer_pipeline_en_5.4.2_3.0_1724674938027.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_norwegian_answer_pipeline_en_5.4.2_3.0_1724674938027.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qg_norwegian_answer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qg_norwegian_answer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_norwegian_answer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-squad-qg-no-answer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_en.md new file mode 100644 index 00000000000000..d2f4440afe8d35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_synthetic_flute T5Transformer from RicoBorra +author: John Snow Labs +name: t5_small_synthetic_flute +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_synthetic_flute` is a English model originally trained by RicoBorra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_synthetic_flute_en_5.4.2_3.0_1724660697698.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_synthetic_flute_en_5.4.2_3.0_1724660697698.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_synthetic_flute","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_synthetic_flute", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_synthetic_flute| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.1 MB| + +## References + +https://huggingface.co/RicoBorra/T5-small-synthetic-FLUTE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_pipeline_en.md new file mode 100644 index 00000000000000..e2110d06be3e4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_synthetic_flute_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_synthetic_flute_pipeline pipeline T5Transformer from RicoBorra +author: John Snow Labs +name: t5_small_synthetic_flute_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_synthetic_flute_pipeline` is a English model originally trained by RicoBorra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_synthetic_flute_pipeline_en_5.4.2_3.0_1724660714934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_synthetic_flute_pipeline_en_5.4.2_3.0_1724660714934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_synthetic_flute_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_synthetic_flute_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_synthetic_flute_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.1 MB| + +## References + +https://huggingface.co/RicoBorra/T5-small-synthetic-FLUTE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_en.md new file mode 100644 index 00000000000000..595b337b1d40e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_t5small_nl2bash_testmetric T5Transformer from Josh98 +author: John Snow Labs +name: t5_small_t5small_nl2bash_testmetric +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_t5small_nl2bash_testmetric` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_t5small_nl2bash_testmetric_en_5.4.2_3.0_1724690702231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_t5small_nl2bash_testmetric_en_5.4.2_3.0_1724690702231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_t5small_nl2bash_testmetric","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_t5small_nl2bash_testmetric", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_t5small_nl2bash_testmetric| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.3 MB| + +## References + +https://huggingface.co/Josh98/t5-small-t5small-NL2BASH_testmetric \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_pipeline_en.md new file mode 100644 index 00000000000000..9a64da256ca51e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_small_t5small_nl2bash_testmetric_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_t5small_nl2bash_testmetric_pipeline pipeline T5Transformer from Josh98 +author: John Snow Labs +name: t5_small_t5small_nl2bash_testmetric_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_t5small_nl2bash_testmetric_pipeline` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_t5small_nl2bash_testmetric_pipeline_en_5.4.2_3.0_1724690721725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_t5small_nl2bash_testmetric_pipeline_en_5.4.2_3.0_1724690721725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_t5small_nl2bash_testmetric_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_t5small_nl2bash_testmetric_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_t5small_nl2bash_testmetric_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.3 MB| + +## References + +https://huggingface.co/Josh98/t5-small-t5small-NL2BASH_testmetric + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_en.md new file mode 100644 index 00000000000000..cd4b44d56f86df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_story_keys T5Transformer from dquisi +author: John Snow Labs +name: t5_story_keys +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_story_keys` is a English model originally trained by dquisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_story_keys_en_5.4.2_3.0_1724693203688.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_story_keys_en_5.4.2_3.0_1724693203688.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_story_keys","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_story_keys", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_story_keys| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dquisi/T5-story-keys \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_pipeline_en.md new file mode 100644 index 00000000000000..46d1c43b7f6d03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_story_keys_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_story_keys_pipeline pipeline T5Transformer from dquisi +author: John Snow Labs +name: t5_story_keys_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_story_keys_pipeline` is a English model originally trained by dquisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_story_keys_pipeline_en_5.4.2_3.0_1724693250716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_story_keys_pipeline_en_5.4.2_3.0_1724693250716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_story_keys_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_story_keys_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_story_keys_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dquisi/T5-story-keys + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_en.md new file mode 100644 index 00000000000000..c506786472bb38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_summarization_multinews T5Transformer from osama7 +author: John Snow Labs +name: t5_summarization_multinews +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_multinews` is a English model originally trained by osama7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_multinews_en_5.4.2_3.0_1724701875957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_multinews_en_5.4.2_3.0_1724701875957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_summarization_multinews","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_summarization_multinews", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_multinews| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/osama7/t5-summarization-multinews \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_pipeline_en.md new file mode 100644 index 00000000000000..78054a6b9634b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_summarization_multinews_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_summarization_multinews_pipeline pipeline T5Transformer from osama7 +author: John Snow Labs +name: t5_summarization_multinews_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_multinews_pipeline` is a English model originally trained by osama7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_multinews_pipeline_en_5.4.2_3.0_1724701924219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_multinews_pipeline_en_5.4.2_3.0_1724701924219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_summarization_multinews_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_summarization_multinews_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_multinews_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/osama7/t5-summarization-multinews + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_en.md new file mode 100644 index 00000000000000..c12ebae362065d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724688822270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724688822270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.02-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md new file mode 100644 index 00000000000000..0baab9c62a29a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline pipeline T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724688823841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724688823841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_2e_05_weight_decay_0_02_finetuned_english_tonga_tonga_islands_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|24.1 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-2e-05-weight_decay-0.02-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_en.md new file mode 100644 index 00000000000000..3631de35ddf4fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_translation_mprimus T5Transformer from Mprimus +author: John Snow Labs +name: t5_translation_mprimus +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_translation_mprimus` is a English model originally trained by Mprimus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_translation_mprimus_en_5.4.2_3.0_1724640946738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_translation_mprimus_en_5.4.2_3.0_1724640946738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_translation_mprimus","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_translation_mprimus", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_translation_mprimus| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.9 MB| + +## References + +https://huggingface.co/Mprimus/T5-translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_pipeline_en.md new file mode 100644 index 00000000000000..490ad6b0165652 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_translation_mprimus_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_translation_mprimus_pipeline pipeline T5Transformer from Mprimus +author: John Snow Labs +name: t5_translation_mprimus_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_translation_mprimus_pipeline` is a English model originally trained by Mprimus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_translation_mprimus_pipeline_en_5.4.2_3.0_1724640993452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_translation_mprimus_pipeline_en_5.4.2_3.0_1724640993452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_translation_mprimus_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_translation_mprimus_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_translation_mprimus_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.9 MB| + +## References + +https://huggingface.co/Mprimus/T5-translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_en.md new file mode 100644 index 00000000000000..aeda4f371b085a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_base_codexglue T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_base_codexglue +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_codexglue` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_codexglue_en_5.4.2_3.0_1724694734929.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_codexglue_en_5.4.2_3.0_1724694734929.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_base_codexglue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_base_codexglue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_codexglue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/lintang/t5-v1_1-base-codexglue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_pipeline_en.md new file mode 100644 index 00000000000000..ac5a9cabe79f2a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_base_codexglue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_base_codexglue_pipeline pipeline T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_base_codexglue_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_codexglue_pipeline` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_codexglue_pipeline_en_5.4.2_3.0_1724694789546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_codexglue_pipeline_en_5.4.2_3.0_1724694789546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_base_codexglue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_base_codexglue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_codexglue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/lintang/t5-v1_1-base-codexglue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_en.md new file mode 100644 index 00000000000000..19622e028466be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_large_flan T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_large_flan +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_flan` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_flan_en_5.4.2_3.0_1724672458884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_flan_en_5.4.2_3.0_1724672458884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_large_flan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_large_flan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_flan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lintang/t5-v1_1-large-flan \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_pipeline_en.md new file mode 100644 index 00000000000000..4dd588e771d608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_v1_1_large_flan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_large_flan_pipeline pipeline T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_large_flan_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_flan_pipeline` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_flan_pipeline_en_5.4.2_3.0_1724672606669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_flan_pipeline_en_5.4.2_3.0_1724672606669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_large_flan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_large_flan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_flan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lintang/t5-v1_1-large-flan + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_en.md new file mode 100644 index 00000000000000..76cc41e65bb360 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_xsum_base T5Transformer from alexrodpas +author: John Snow Labs +name: t5_xsum_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_xsum_base` is a English model originally trained by alexrodpas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_xsum_base_en_5.4.2_3.0_1724672444155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_xsum_base_en_5.4.2_3.0_1724672444155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_xsum_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_xsum_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_xsum_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/alexrodpas/T5-XSum-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_pipeline_en.md new file mode 100644 index 00000000000000..8e87d247d7854d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5_xsum_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_xsum_base_pipeline pipeline T5Transformer from alexrodpas +author: John Snow Labs +name: t5_xsum_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_xsum_base_pipeline` is a English model originally trained by alexrodpas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_xsum_base_pipeline_en_5.4.2_3.0_1724672462931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_xsum_base_pipeline_en_5.4.2_3.0_1724672462931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_xsum_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_xsum_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_xsum_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/alexrodpas/T5-XSum-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_en.md new file mode 100644 index 00000000000000..5d744a5ee60c55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_adv_md5_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_md5_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_md5_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_md5_2_en_5.4.2_3.0_1724695110257.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_md5_2_en_5.4.2_3.0_1724695110257.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_adv_md5_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_adv_md5_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_md5_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_md5_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_pipeline_en.md new file mode 100644 index 00000000000000..ab0add1e6e802e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_adv_md5_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_adv_md5_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_md5_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_md5_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_md5_2_pipeline_en_5.4.2_3.0_1724695259156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_md5_2_pipeline_en_5.4.2_3.0_1724695259156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_adv_md5_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_adv_md5_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_md5_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_md5_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_0_en.md new file mode 100644 index 00000000000000..f5917d2c4e2892 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_label_trigger_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_label_trigger_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_label_trigger_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_0_en_5.4.2_3.0_1724664502299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_0_en_5.4.2_3.0_1724664502299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_label_trigger_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_label_trigger_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_en.md new file mode 100644 index 00000000000000..4922c7db579e9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_label_trigger_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_label_trigger_2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_label_trigger_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_2_en_5.4.2_3.0_1724667712879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_2_en_5.4.2_3.0_1724667712879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_label_trigger_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_label_trigger_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_pipeline_en.md new file mode 100644 index 00000000000000..662e29d72be8a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_hate_speech_label_trigger_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_label_trigger_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_label_trigger_2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_label_trigger_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_2_pipeline_en_5.4.2_3.0_1724667861052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_2_pipeline_en_5.4.2_3.0_1724667861052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_label_trigger_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_label_trigger_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_label_trigger_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_label_trigger_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_en.md new file mode 100644 index 00000000000000..c46938406349a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_rare_word_cf_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_rare_word_cf_0 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_rare_word_cf_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_rare_word_cf_0_en_5.4.2_3.0_1724645807031.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_rare_word_cf_0_en_5.4.2_3.0_1724645807031.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_rare_word_cf_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_rare_word_cf_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_rare_word_cf_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_rare_word_cf_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_pipeline_en.md new file mode 100644 index 00000000000000..675d2428157dfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_rare_word_cf_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_rare_word_cf_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_rare_word_cf_0_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_rare_word_cf_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724645935489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724645935489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_rare_word_cf_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_rare_word_cf_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_rare_word_cf_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_rare_word_cf_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_en.md new file mode 100644 index 00000000000000..94fb315c309228 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_syntactic_adv_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_syntactic_adv_instruction_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_syntactic_adv_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_1_en_5.4.2_3.0_1724657206066.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_1_en_5.4.2_3.0_1724657206066.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_syntactic_adv_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_syntactic_adv_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_syntactic_adv_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_syntactic_adv_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..9dbad60de33e43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_sst2_syntactic_adv_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_syntactic_adv_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_syntactic_adv_instruction_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_syntactic_adv_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724657346871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724657346871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_syntactic_adv_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_syntactic_adv_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_syntactic_adv_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_syntactic_adv_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_en.md new file mode 100644 index 00000000000000..3cc4feccaf764a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_syntactic_adv_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_syntactic_adv_instruction_1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_syntactic_adv_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_1_en_5.4.2_3.0_1724662517769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_1_en_5.4.2_3.0_1724662517769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_syntactic_adv_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_syntactic_adv_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_syntactic_adv_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_syntactic_adv_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..e1d767d9e4a6e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724662657532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724662657532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_syntactic_adv_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_syntactic_adv_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-testt5_en.md b/docs/_posts/ahmedlone127/2024-08-26-testt5_en.md new file mode 100644 index 00000000000000..0c93232ed39d92 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-testt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English testt5 T5Transformer from d0r1h +author: John Snow Labs +name: testt5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testt5` is a English model originally trained by d0r1h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testt5_en_5.4.2_3.0_1724668988121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testt5_en_5.4.2_3.0_1724668988121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("testt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("testt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.8 MB| + +## References + +https://huggingface.co/d0r1h/testt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-testt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-testt5_pipeline_en.md new file mode 100644 index 00000000000000..f71ce9f079d925 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-testt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English testt5_pipeline pipeline T5Transformer from d0r1h +author: John Snow Labs +name: testt5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testt5_pipeline` is a English model originally trained by d0r1h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testt5_pipeline_en_5.4.2_3.0_1724669008221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testt5_pipeline_en_5.4.2_3.0_1724669008221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("testt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("testt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.8 MB| + +## References + +https://huggingface.co/d0r1h/testt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_en.md new file mode 100644 index 00000000000000..ccb33405ba23f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text2sql_t5_base T5Transformer from radu-matei +author: John Snow Labs +name: text2sql_t5_base +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_t5_base` is a English model originally trained by radu-matei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_t5_base_en_5.4.2_3.0_1724651218306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_t5_base_en_5.4.2_3.0_1724651218306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text2sql_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text2sql_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/radu-matei/text2sql-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..57e5983c394817 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text2sql_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text2sql_t5_base_pipeline pipeline T5Transformer from radu-matei +author: John Snow Labs +name: text2sql_t5_base_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_t5_base_pipeline` is a English model originally trained by radu-matei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_t5_base_pipeline_en_5.4.2_3.0_1724651266220.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_t5_base_pipeline_en_5.4.2_3.0_1724651266220.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text2sql_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text2sql_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/radu-matei/text2sql-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_en.md new file mode 100644 index 00000000000000..0b44f2fb1eadd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v74 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v74 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v74` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v74_en_5.4.2_3.0_1724685239299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v74_en_5.4.2_3.0_1724685239299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v74","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v74", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v74| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v74 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_pipeline_en.md new file mode 100644 index 00000000000000..06626e394fbd84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_shortening_model_v74_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v74_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v74_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v74_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v74_pipeline_en_5.4.2_3.0_1724685262841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v74_pipeline_en_5.4.2_3.0_1724685262841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v74_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v74_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v74_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.9 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v74 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_en.md new file mode 100644 index 00000000000000..f36293dd44bafc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_sum_po1 T5Transformer from Mikune +author: John Snow Labs +name: text_sum_po1 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_sum_po1` is a English model originally trained by Mikune. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_sum_po1_en_5.4.2_3.0_1724678158600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_sum_po1_en_5.4.2_3.0_1724678158600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_sum_po1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_sum_po1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_sum_po1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Mikune/text-sum-po1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_pipeline_en.md new file mode 100644 index 00000000000000..65b531d1a2f98f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_sum_po1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_sum_po1_pipeline pipeline T5Transformer from Mikune +author: John Snow Labs +name: text_sum_po1_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_sum_po1_pipeline` is a English model originally trained by Mikune. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_sum_po1_pipeline_en_5.4.2_3.0_1724678212912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_sum_po1_pipeline_en_5.4.2_3.0_1724678212912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_sum_po1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_sum_po1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_sum_po1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Mikune/text-sum-po1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_en.md new file mode 100644 index 00000000000000..bee47e3444dd24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_summarization_neupane9sujal T5Transformer from Neupane9Sujal +author: John Snow Labs +name: text_summarization_neupane9sujal +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_neupane9sujal` is a English model originally trained by Neupane9Sujal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_neupane9sujal_en_5.4.2_3.0_1724700244644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_neupane9sujal_en_5.4.2_3.0_1724700244644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_summarization_neupane9sujal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_summarization_neupane9sujal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_neupane9sujal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/Neupane9Sujal/Text_Summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_pipeline_en.md new file mode 100644 index 00000000000000..4c4a3f90d8244e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-text_summarization_neupane9sujal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_summarization_neupane9sujal_pipeline pipeline T5Transformer from Neupane9Sujal +author: John Snow Labs +name: text_summarization_neupane9sujal_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_neupane9sujal_pipeline` is a English model originally trained by Neupane9Sujal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_neupane9sujal_pipeline_en_5.4.2_3.0_1724700265489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_neupane9sujal_pipeline_en_5.4.2_3.0_1724700265489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_summarization_neupane9sujal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_summarization_neupane9sujal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_neupane9sujal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/Neupane9Sujal/Text_Summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-thai_mt5_base_finetuned_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-26-thai_mt5_base_finetuned_wikisql_en.md new file mode 100644 index 00000000000000..65f9acec7a9c69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-thai_mt5_base_finetuned_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English thai_mt5_base_finetuned_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: thai_mt5_base_finetuned_wikisql +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`thai_mt5_base_finetuned_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/thai_mt5_base_finetuned_wikisql_en_5.4.2_3.0_1724692816834.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/thai_mt5_base_finetuned_wikisql_en_5.4.2_3.0_1724692816834.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("thai_mt5_base_finetuned_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("thai_mt5_base_finetuned_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|thai_mt5_base_finetuned_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/e22vvb/TH_mt5-base-finetuned-wikisql \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_en.md b/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_en.md new file mode 100644 index 00000000000000..cfa3482355bd9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English timelist_cointegrated_paraphraser T5Transformer from marcus2000 +author: John Snow Labs +name: timelist_cointegrated_paraphraser +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`timelist_cointegrated_paraphraser` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/timelist_cointegrated_paraphraser_en_5.4.2_3.0_1724687171301.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/timelist_cointegrated_paraphraser_en_5.4.2_3.0_1724687171301.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("timelist_cointegrated_paraphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("timelist_cointegrated_paraphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|timelist_cointegrated_paraphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.8 MB| + +## References + +https://huggingface.co/marcus2000/timelist_cointegrated_paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_pipeline_en.md new file mode 100644 index 00000000000000..8ad00019fc685a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-timelist_cointegrated_paraphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English timelist_cointegrated_paraphraser_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: timelist_cointegrated_paraphraser_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`timelist_cointegrated_paraphraser_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/timelist_cointegrated_paraphraser_pipeline_en_5.4.2_3.0_1724687223543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/timelist_cointegrated_paraphraser_pipeline_en_5.4.2_3.0_1724687223543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("timelist_cointegrated_paraphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("timelist_cointegrated_paraphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|timelist_cointegrated_paraphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.8 MB| + +## References + +https://huggingface.co/marcus2000/timelist_cointegrated_paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_en.md b/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_en.md new file mode 100644 index 00000000000000..c36be3deeade42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tns_ft5tech T5Transformer from PhLoDuTi +author: John Snow Labs +name: tns_ft5tech +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tns_ft5tech` is a English model originally trained by PhLoDuTi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tns_ft5tech_en_5.4.2_3.0_1724662231203.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tns_ft5tech_en_5.4.2_3.0_1724662231203.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tns_ft5tech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tns_ft5tech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tns_ft5tech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/PhLoDuTi/tns_ft5tech \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_pipeline_en.md new file mode 100644 index 00000000000000..52222bf45ed0ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-tns_ft5tech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tns_ft5tech_pipeline pipeline T5Transformer from PhLoDuTi +author: John Snow Labs +name: tns_ft5tech_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tns_ft5tech_pipeline` is a English model originally trained by PhLoDuTi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tns_ft5tech_pipeline_en_5.4.2_3.0_1724662248018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tns_ft5tech_pipeline_en_5.4.2_3.0_1724662248018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tns_ft5tech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tns_ft5tech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tns_ft5tech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/PhLoDuTi/tns_ft5tech + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_en.md b/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_en.md new file mode 100644 index 00000000000000..4a2009e3e0142b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translation_english_vietnamese_baseline T5Transformer from NguyenManhAI +author: John Snow Labs +name: translation_english_vietnamese_baseline +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_english_vietnamese_baseline` is a English model originally trained by NguyenManhAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_english_vietnamese_baseline_en_5.4.2_3.0_1724630993629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_english_vietnamese_baseline_en_5.4.2_3.0_1724630993629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_english_vietnamese_baseline","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_english_vietnamese_baseline", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_english_vietnamese_baseline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.2 MB| + +## References + +https://huggingface.co/NguyenManhAI/translation-en-vi-baseline \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_pipeline_en.md new file mode 100644 index 00000000000000..6a3db92586dacb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-translation_english_vietnamese_baseline_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translation_english_vietnamese_baseline_pipeline pipeline T5Transformer from NguyenManhAI +author: John Snow Labs +name: translation_english_vietnamese_baseline_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_english_vietnamese_baseline_pipeline` is a English model originally trained by NguyenManhAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_english_vietnamese_baseline_pipeline_en_5.4.2_3.0_1724631011870.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_english_vietnamese_baseline_pipeline_en_5.4.2_3.0_1724631011870.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_english_vietnamese_baseline_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_english_vietnamese_baseline_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_english_vietnamese_baseline_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.2 MB| + +## References + +https://huggingface.co/NguyenManhAI/translation-en-vi-baseline + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_en.md b/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_en.md new file mode 100644 index 00000000000000..e2ecdb928053b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_small T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_en_5.4.2_3.0_1724707045230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_en_5.4.2_3.0_1724707045230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_pipeline_en.md new file mode 100644 index 00000000000000..7df3795caf8fb9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-turkmen_instruct_squad_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_small_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_pipeline_en_5.4.2_3.0_1724707107276.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_pipeline_en_5.4.2_3.0_1724707107276.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-uihefir_en.md b/docs/_posts/ahmedlone127/2024-08-26-uihefir_en.md new file mode 100644 index 00000000000000..0ae86c3865c075 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-uihefir_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English uihefir T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: uihefir +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`uihefir` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/uihefir_en_5.4.2_3.0_1724656605199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/uihefir_en_5.4.2_3.0_1724656605199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("uihefir","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("uihefir", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|uihefir| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|989.8 MB| + +## References + +https://huggingface.co/AliGhiasvand86/uihefir \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-uihefir_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-uihefir_pipeline_en.md new file mode 100644 index 00000000000000..18aaf27f694ad8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-uihefir_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English uihefir_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: uihefir_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`uihefir_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/uihefir_pipeline_en_5.4.2_3.0_1724656658821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/uihefir_pipeline_en_5.4.2_3.0_1724656658821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("uihefir_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("uihefir_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|uihefir_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|989.8 MB| + +## References + +https://huggingface.co/AliGhiasvand86/uihefir + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_en.md b/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_en.md new file mode 100644 index 00000000000000..ff990d81e83822 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ukrainian_mt5_large_gec_tokenized T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_large_gec_tokenized +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_large_gec_tokenized` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_large_gec_tokenized_en_5.4.2_3.0_1724669319144.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_large_gec_tokenized_en_5.4.2_3.0_1724669319144.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ukrainian_mt5_large_gec_tokenized","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ukrainian_mt5_large_gec_tokenized", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_large_gec_tokenized| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-large-gec-tokenized \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_pipeline_en.md new file mode 100644 index 00000000000000..cb0077b7df49b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-ukrainian_mt5_large_gec_tokenized_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ukrainian_mt5_large_gec_tokenized_pipeline pipeline T5Transformer from kravchenko +author: John Snow Labs +name: ukrainian_mt5_large_gec_tokenized_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ukrainian_mt5_large_gec_tokenized_pipeline` is a English model originally trained by kravchenko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_large_gec_tokenized_pipeline_en_5.4.2_3.0_1724669467200.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ukrainian_mt5_large_gec_tokenized_pipeline_en_5.4.2_3.0_1724669467200.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ukrainian_mt5_large_gec_tokenized_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ukrainian_mt5_large_gec_tokenized_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ukrainian_mt5_large_gec_tokenized_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kravchenko/uk-mt5-large-gec-tokenized + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_en.md b/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_en.md new file mode 100644 index 00000000000000..b9837d4cc76668 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English unieval_intermediate T5Transformer from MingZhong +author: John Snow Labs +name: unieval_intermediate +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unieval_intermediate` is a English model originally trained by MingZhong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unieval_intermediate_en_5.4.2_3.0_1724686100212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unieval_intermediate_en_5.4.2_3.0_1724686100212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("unieval_intermediate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("unieval_intermediate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unieval_intermediate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/MingZhong/unieval-intermediate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_pipeline_en.md new file mode 100644 index 00000000000000..94333c725ce53e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-unieval_intermediate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English unieval_intermediate_pipeline pipeline T5Transformer from MingZhong +author: John Snow Labs +name: unieval_intermediate_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unieval_intermediate_pipeline` is a English model originally trained by MingZhong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unieval_intermediate_pipeline_en_5.4.2_3.0_1724686246010.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unieval_intermediate_pipeline_en_5.4.2_3.0_1724686246010.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("unieval_intermediate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("unieval_intermediate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unieval_intermediate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/MingZhong/unieval-intermediate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_en.md b/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_en.md new file mode 100644 index 00000000000000..e599174b86643b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English uptag_url_model_v2 T5Transformer from Suva +author: John Snow Labs +name: uptag_url_model_v2 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`uptag_url_model_v2` is a English model originally trained by Suva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/uptag_url_model_v2_en_5.4.2_3.0_1724676067328.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/uptag_url_model_v2_en_5.4.2_3.0_1724676067328.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("uptag_url_model_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("uptag_url_model_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|uptag_url_model_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suva/uptag-url-model-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_pipeline_en.md new file mode 100644 index 00000000000000..b3594d3ab51607 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-uptag_url_model_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English uptag_url_model_v2_pipeline pipeline T5Transformer from Suva +author: John Snow Labs +name: uptag_url_model_v2_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`uptag_url_model_v2_pipeline` is a English model originally trained by Suva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/uptag_url_model_v2_pipeline_en_5.4.2_3.0_1724676114825.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/uptag_url_model_v2_pipeline_en_5.4.2_3.0_1724676114825.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("uptag_url_model_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("uptag_url_model_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|uptag_url_model_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suva/uptag-url-model-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_en.md b/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_en.md new file mode 100644 index 00000000000000..495eeaa9f3f927 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English urukhan_based T5Transformer from NikitaKukuzey +author: John Snow Labs +name: urukhan_based +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`urukhan_based` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/urukhan_based_en_5.4.2_3.0_1724672147272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/urukhan_based_en_5.4.2_3.0_1724672147272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("urukhan_based","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("urukhan_based", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|urukhan_based| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NikitaKukuzey/Urukhan_based \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_pipeline_en.md new file mode 100644 index 00000000000000..b723ad14416cc0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-urukhan_based_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English urukhan_based_pipeline pipeline T5Transformer from NikitaKukuzey +author: John Snow Labs +name: urukhan_based_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`urukhan_based_pipeline` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/urukhan_based_pipeline_en_5.4.2_3.0_1724672195080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/urukhan_based_pipeline_en_5.4.2_3.0_1724672195080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("urukhan_based_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("urukhan_based_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|urukhan_based_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NikitaKukuzey/Urukhan_based + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_en.md b/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_en.md new file mode 100644 index 00000000000000..434f405e28f7dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vanilla_mt5_tiny8l_vs32k T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny8l_vs32k +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny8l_vs32k` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny8l_vs32k_en_5.4.2_3.0_1724670594206.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny8l_vs32k_en_5.4.2_3.0_1724670594206.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vanilla_mt5_tiny8l_vs32k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vanilla_mt5_tiny8l_vs32k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny8l_vs32k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|67.0 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny8L-vs32k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_pipeline_en.md new file mode 100644 index 00000000000000..7d8a91b81db566 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vanilla_mt5_tiny8l_vs32k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vanilla_mt5_tiny8l_vs32k_pipeline pipeline T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny8l_vs32k_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny8l_vs32k_pipeline` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny8l_vs32k_pipeline_en_5.4.2_3.0_1724670597710.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny8l_vs32k_pipeline_en_5.4.2_3.0_1724670597710.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vanilla_mt5_tiny8l_vs32k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vanilla_mt5_tiny8l_vs32k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny8l_vs32k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|67.0 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny8L-vs32k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_en.md new file mode 100644 index 00000000000000..f5527d960d9976 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_translation_half_doc_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_translation_half_doc_news_train +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_translation_half_doc_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_half_doc_news_train_en_5.4.2_3.0_1724709467801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_half_doc_news_train_en_5.4.2_3.0_1724709467801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_translation_half_doc_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_translation_half_doc_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_translation_half_doc_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-translation_half_doc_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_pipeline_en.md new file mode 100644 index 00000000000000..c66a26cd96a525 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vietnamese_english_envit5_translation_half_doc_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_translation_half_doc_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_translation_half_doc_news_train_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_translation_half_doc_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_half_doc_news_train_pipeline_en_5.4.2_3.0_1724709544447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_translation_half_doc_news_train_pipeline_en_5.4.2_3.0_1724709544447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_translation_half_doc_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_translation_half_doc_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_translation_half_doc_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-translation_half_doc_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_en.md b/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_en.md new file mode 100644 index 00000000000000..80cf15fd087c84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_multitask_fcd T5Transformer from hoangphu7122002ai +author: John Snow Labs +name: vit5_multitask_fcd +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_multitask_fcd` is a English model originally trained by hoangphu7122002ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_multitask_fcd_en_5.4.2_3.0_1724691603237.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_multitask_fcd_en_5.4.2_3.0_1724691603237.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_multitask_fcd","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_multitask_fcd", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_multitask_fcd| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hoangphu7122002ai/ViT5_multitask_fcd \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_pipeline_en.md new file mode 100644 index 00000000000000..8bf43ff1fefe08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-vit5_multitask_fcd_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_multitask_fcd_pipeline pipeline T5Transformer from hoangphu7122002ai +author: John Snow Labs +name: vit5_multitask_fcd_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_multitask_fcd_pipeline` is a English model originally trained by hoangphu7122002ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_multitask_fcd_pipeline_en_5.4.2_3.0_1724691655170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_multitask_fcd_pipeline_en_5.4.2_3.0_1724691655170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_multitask_fcd_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_multitask_fcd_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_multitask_fcd_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hoangphu7122002ai/ViT5_multitask_fcd + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_en.md b/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_en.md new file mode 100644 index 00000000000000..733d7aa7ac8585 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wayne_nlp_t5 T5Transformer from Waynehillsdev +author: John Snow Labs +name: wayne_nlp_t5 +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wayne_nlp_t5` is a English model originally trained by Waynehillsdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wayne_nlp_t5_en_5.4.2_3.0_1724704282169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wayne_nlp_t5_en_5.4.2_3.0_1724704282169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wayne_nlp_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wayne_nlp_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wayne_nlp_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Waynehillsdev/Wayne_NLP_T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_pipeline_en.md new file mode 100644 index 00000000000000..35353d2f1a4490 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-wayne_nlp_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wayne_nlp_t5_pipeline pipeline T5Transformer from Waynehillsdev +author: John Snow Labs +name: wayne_nlp_t5_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wayne_nlp_t5_pipeline` is a English model originally trained by Waynehillsdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wayne_nlp_t5_pipeline_en_5.4.2_3.0_1724704331361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wayne_nlp_t5_pipeline_en_5.4.2_3.0_1724704331361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wayne_nlp_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wayne_nlp_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wayne_nlp_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Waynehillsdev/Wayne_NLP_T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-wiki2json_en.md b/docs/_posts/ahmedlone127/2024-08-26-wiki2json_en.md new file mode 100644 index 00000000000000..cac7cf70b6c324 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-wiki2json_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wiki2json T5Transformer from jourlin +author: John Snow Labs +name: wiki2json +date: 2024-08-26 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wiki2json` is a English model originally trained by jourlin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wiki2json_en_5.4.2_3.0_1724709059473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wiki2json_en_5.4.2_3.0_1724709059473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wiki2json","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wiki2json", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wiki2json| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/jourlin/wiki2json \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-26-wiki2json_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-26-wiki2json_pipeline_en.md new file mode 100644 index 00000000000000..1356dfb0123ab8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-26-wiki2json_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wiki2json_pipeline pipeline T5Transformer from jourlin +author: John Snow Labs +name: wiki2json_pipeline +date: 2024-08-26 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wiki2json_pipeline` is a English model originally trained by jourlin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wiki2json_pipeline_en_5.4.2_3.0_1724709080638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wiki2json_pipeline_en_5.4.2_3.0_1724709080638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wiki2json_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wiki2json_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wiki2json_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/jourlin/wiki2json + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-20240507_4_en.md b/docs/_posts/ahmedlone127/2024-08-27-20240507_4_en.md new file mode 100644 index 00000000000000..e3b057ef4b300b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-20240507_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240507_4 T5Transformer from picas9dan +author: John Snow Labs +name: 20240507_4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240507_4` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240507_4_en_5.4.2_3.0_1724753575419.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240507_4_en_5.4.2_3.0_1724753575419.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240507_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240507_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240507_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240507_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-20240507_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-20240507_4_pipeline_en.md new file mode 100644 index 00000000000000..4f74c904a0a917 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-20240507_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240507_4_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240507_4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240507_4_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240507_4_pipeline_en_5.4.2_3.0_1724753624597.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240507_4_pipeline_en_5.4.2_3.0_1724753624597.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240507_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240507_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240507_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240507_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_en.md b/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_en.md new file mode 100644 index 00000000000000..9d81256be79711 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English advanced_t5_large_model T5Transformer from sammanamgain +author: John Snow Labs +name: advanced_t5_large_model +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`advanced_t5_large_model` is a English model originally trained by sammanamgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/advanced_t5_large_model_en_5.4.2_3.0_1724719197382.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/advanced_t5_large_model_en_5.4.2_3.0_1724719197382.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("advanced_t5_large_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("advanced_t5_large_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|advanced_t5_large_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sammanamgain/advanced-T5-large-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_pipeline_en.md new file mode 100644 index 00000000000000..12be19ad488a36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-advanced_t5_large_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English advanced_t5_large_model_pipeline pipeline T5Transformer from sammanamgain +author: John Snow Labs +name: advanced_t5_large_model_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`advanced_t5_large_model_pipeline` is a English model originally trained by sammanamgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/advanced_t5_large_model_pipeline_en_5.4.2_3.0_1724719335422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/advanced_t5_large_model_pipeline_en_5.4.2_3.0_1724719335422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("advanced_t5_large_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("advanced_t5_large_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|advanced_t5_large_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sammanamgain/advanced-T5-large-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_en.md new file mode 100644 index 00000000000000..05e9f320a9cd5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_10_wikisql T5Transformer from NatthawatTung +author: John Snow Labs +name: all_mt5_base_10_wikisql +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_10_wikisql` is a English model originally trained by NatthawatTung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_wikisql_en_5.4.2_3.0_1724767144273.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_wikisql_en_5.4.2_3.0_1724767144273.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_10_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_10_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_10_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/NatthawatTung/ALL_mt5-base_10_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_pipeline_en.md new file mode 100644 index 00000000000000..291719c2ffd796 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_10_wikisql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_10_wikisql_pipeline pipeline T5Transformer from NatthawatTung +author: John Snow Labs +name: all_mt5_base_10_wikisql_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_10_wikisql_pipeline` is a English model originally trained by NatthawatTung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_wikisql_pipeline_en_5.4.2_3.0_1724767403741.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_wikisql_pipeline_en_5.4.2_3.0_1724767403741.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_10_wikisql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_10_wikisql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_10_wikisql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/NatthawatTung/ALL_mt5-base_10_wikiSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_en.md b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_en.md new file mode 100644 index 00000000000000..02744e537e54eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_15_spider_new2 T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_new2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_new2` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_new2_en_5.4.2_3.0_1724768681941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_new2_en_5.4.2_3.0_1724768681941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_15_spider_new2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_15_spider_new2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_new2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_new2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_pipeline_en.md new file mode 100644 index 00000000000000..43cfc6758eaac4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-all_mt5_base_15_spider_new2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_15_spider_new2_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_new2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_new2_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_new2_pipeline_en_5.4.2_3.0_1724769003302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_new2_pipeline_en_5.4.2_3.0_1724769003302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_15_spider_new2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_15_spider_new2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_new2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_new2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_en.md b/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_en.md new file mode 100644 index 00000000000000..7c1c014e75ad7e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_msa_base_8bit T5Transformer from asas-ai +author: John Snow Labs +name: arat5_msa_base_8bit +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_msa_base_8bit` is a English model originally trained by asas-ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_msa_base_8bit_en_5.4.2_3.0_1724742387180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_msa_base_8bit_en_5.4.2_3.0_1724742387180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_msa_base_8bit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_msa_base_8bit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_msa_base_8bit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|800.6 MB| + +## References + +https://huggingface.co/asas-ai/AraT5_msa_base_8bit \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_pipeline_en.md new file mode 100644 index 00000000000000..659e365911592a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-arat5_msa_base_8bit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_msa_base_8bit_pipeline pipeline T5Transformer from asas-ai +author: John Snow Labs +name: arat5_msa_base_8bit_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_msa_base_8bit_pipeline` is a English model originally trained by asas-ai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_msa_base_8bit_pipeline_en_5.4.2_3.0_1724742652111.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_msa_base_8bit_pipeline_en_5.4.2_3.0_1724742652111.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_msa_base_8bit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_msa_base_8bit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_msa_base_8bit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|800.6 MB| + +## References + +https://huggingface.co/asas-ai/AraT5_msa_base_8bit + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_en.md b/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_en.md new file mode 100644 index 00000000000000..eb018a5d98279c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_paraphrasing T5Transformer from medmediani +author: John Snow Labs +name: arat5_paraphrasing +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_paraphrasing` is a English model originally trained by medmediani. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_paraphrasing_en_5.4.2_3.0_1724765659381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_paraphrasing_en_5.4.2_3.0_1724765659381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_paraphrasing","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_paraphrasing", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_paraphrasing| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|734.3 MB| + +## References + +https://huggingface.co/medmediani/AraT5-Paraphrasing \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_pipeline_en.md new file mode 100644 index 00000000000000..18a7685812e636 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-arat5_paraphrasing_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_paraphrasing_pipeline pipeline T5Transformer from medmediani +author: John Snow Labs +name: arat5_paraphrasing_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_paraphrasing_pipeline` is a English model originally trained by medmediani. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_paraphrasing_pipeline_en_5.4.2_3.0_1724765692326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_paraphrasing_pipeline_en_5.4.2_3.0_1724765692326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_paraphrasing_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_paraphrasing_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_paraphrasing_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|734.3 MB| + +## References + +https://huggingface.co/medmediani/AraT5-Paraphrasing + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..c624611753c77c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_data_with_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_with_edge_document_level_t5_run1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_with_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724753398741.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724753398741.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_data_with_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_data_with_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_with_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.3 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_with_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..33a6042caf59a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-augmented_data_with_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_data_with_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_data_with_edge_document_level_t5_run1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_data_with_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724753417658.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_data_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724753417658.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_data_with_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_data_with_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_data_with_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.3 MB| + +## References + +https://huggingface.co/sheoran95/augmented_data_with_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_en.md b/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_en.md new file mode 100644 index 00000000000000..cba89f740927aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_dlpeu_yhob0 T5Transformer from jylee55 +author: John Snow Labs +name: autotrain_dlpeu_yhob0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_dlpeu_yhob0` is a English model originally trained by jylee55. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_dlpeu_yhob0_en_5.4.2_3.0_1724769225744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_dlpeu_yhob0_en_5.4.2_3.0_1724769225744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_dlpeu_yhob0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_dlpeu_yhob0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_dlpeu_yhob0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.8 MB| + +## References + +https://huggingface.co/jylee55/autotrain-dlpeu-yhob0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_pipeline_en.md new file mode 100644 index 00000000000000..24c49e19c48bf0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-autotrain_dlpeu_yhob0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_dlpeu_yhob0_pipeline pipeline T5Transformer from jylee55 +author: John Snow Labs +name: autotrain_dlpeu_yhob0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_dlpeu_yhob0_pipeline` is a English model originally trained by jylee55. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_dlpeu_yhob0_pipeline_en_5.4.2_3.0_1724769277916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_dlpeu_yhob0_pipeline_en_5.4.2_3.0_1724769277916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_dlpeu_yhob0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_dlpeu_yhob0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_dlpeu_yhob0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.8 MB| + +## References + +https://huggingface.co/jylee55/autotrain-dlpeu-yhob0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_en.md b/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_en.md new file mode 100644 index 00000000000000..6f0fd63b3c0756 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_text_generate_1089139622 T5Transformer from tho-clare +author: John Snow Labs +name: autotrain_text_generate_1089139622 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_text_generate_1089139622` is a English model originally trained by tho-clare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_text_generate_1089139622_en_5.4.2_3.0_1724737403588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_text_generate_1089139622_en_5.4.2_3.0_1724737403588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_text_generate_1089139622","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_text_generate_1089139622", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_text_generate_1089139622| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/tho-clare/autotrain-Text-Generate-1089139622 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_pipeline_en.md new file mode 100644 index 00000000000000..6bbf5c22deded4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-autotrain_text_generate_1089139622_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_text_generate_1089139622_pipeline pipeline T5Transformer from tho-clare +author: John Snow Labs +name: autotrain_text_generate_1089139622_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_text_generate_1089139622_pipeline` is a English model originally trained by tho-clare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_text_generate_1089139622_pipeline_en_5.4.2_3.0_1724737601727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_text_generate_1089139622_pipeline_en_5.4.2_3.0_1724737601727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_text_generate_1089139622_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_text_generate_1089139622_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_text_generate_1089139622_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/tho-clare/autotrain-Text-Generate-1089139622 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_en.md b/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_en.md new file mode 100644 index 00000000000000..f73727e41510a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English baltic_languages_table_aug T5Transformer from elena-soare +author: John Snow Labs +name: baltic_languages_table_aug +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`baltic_languages_table_aug` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/baltic_languages_table_aug_en_5.4.2_3.0_1724718840632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/baltic_languages_table_aug_en_5.4.2_3.0_1724718840632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("baltic_languages_table_aug","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("baltic_languages_table_aug", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|baltic_languages_table_aug| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|950.4 MB| + +## References + +https://huggingface.co/elena-soare/bat-table-aug \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_pipeline_en.md new file mode 100644 index 00000000000000..9ac03c3f90c61b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-baltic_languages_table_aug_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English baltic_languages_table_aug_pipeline pipeline T5Transformer from elena-soare +author: John Snow Labs +name: baltic_languages_table_aug_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`baltic_languages_table_aug_pipeline` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/baltic_languages_table_aug_pipeline_en_5.4.2_3.0_1724718907873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/baltic_languages_table_aug_pipeline_en_5.4.2_3.0_1724718907873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("baltic_languages_table_aug_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("baltic_languages_table_aug_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|baltic_languages_table_aug_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|950.4 MB| + +## References + +https://huggingface.co/elena-soare/bat-table-aug + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_en.md b/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_en.md new file mode 100644 index 00000000000000..ec0cec83b89257 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_idiom_translation_v1 T5Transformer from syeda-raisa +author: John Snow Labs +name: bangla_idiom_translation_v1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_translation_v1` is a English model originally trained by syeda-raisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_translation_v1_en_5.4.2_3.0_1724761559233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_translation_v1_en_5.4.2_3.0_1724761559233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_idiom_translation_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_idiom_translation_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_translation_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/syeda-raisa/bangla_idiom_translation_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_pipeline_en.md new file mode 100644 index 00000000000000..1aee1ef7f572b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-bangla_idiom_translation_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_idiom_translation_v1_pipeline pipeline T5Transformer from syeda-raisa +author: John Snow Labs +name: bangla_idiom_translation_v1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_translation_v1_pipeline` is a English model originally trained by syeda-raisa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_translation_v1_pipeline_en_5.4.2_3.0_1724761606622.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_translation_v1_pipeline_en_5.4.2_3.0_1724761606622.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_idiom_translation_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_idiom_translation_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_translation_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/syeda-raisa/bangla_idiom_translation_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-bart_large_zero_shot_classifier_mnli_en.md b/docs/_posts/ahmedlone127/2024-08-27-bart_large_zero_shot_classifier_mnli_en.md new file mode 100644 index 00000000000000..f1990c63e9cd65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-bart_large_zero_shot_classifier_mnli_en.md @@ -0,0 +1,111 @@ +--- +layout: model +title: Bart Zero Shot Classifier Large -MNLI (bart_large_zero_shot_classifier_mnli) +author: John Snow Labs +name: bart_large_zero_shot_classifier_mnli +date: 2024-08-27 +tags: [bart, zero_shot, en, open_source, openvino] +task: Zero-Shot Classification +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: openvino +annotator: BartForZeroShotClassification +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +This model is intended to be used for zero-shot text classification, especially in English. It is fine-tuned on MNLI by using large BART model. + +BartForZeroShotClassification using a ModelForSequenceClassification trained on MNLI tasks. Equivalent of BartForSequenceClassification models, but these models don’t require a hardcoded number of potential classes, they can be chosen at runtime. It usually means it’s slower but it is much more flexible. + +We used TFBartForSequenceClassification to train this model and used BartForZeroShotClassification annotator in Spark NLP 🚀 for prediction at scale! + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bart_large_zero_shot_classifier_mnli_en_5.4.2_3.0_1724771957705.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bart_large_zero_shot_classifier_mnli_en_5.4.2_3.0_1724771957705.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +document_assembler = DocumentAssembler() \ +.setInputCol('text') \ +.setOutputCol('document') + +tokenizer = Tokenizer() \ +.setInputCols(['document']) \ +.setOutputCol('token') + +zeroShotClassifier = BartForZeroShotClassification \ +.pretrained('bart_large_zero_shot_classifier_mnli', 'en') \ +.setInputCols(['token', 'document']) \ +.setOutputCol('class') \ +.setCaseSensitive(True) \ +.setMaxSentenceLength(512) \ +.setCandidateLabels(["urgent", "mobile", "travel", "movie", "music", "sport", "weather", "technology"]) + +pipeline = Pipeline(stages=[ +document_assembler, +tokenizer, +zeroShotClassifier +]) + +example = spark.createDataFrame([['I have a problem with my iphone that needs to be resolved asap!!']]).toDF("text") +result = pipeline.fit(example).transform(example) +``` +```scala +val document_assembler = DocumentAssembler() +.setInputCol("text") +.setOutputCol("document") + +val tokenizer = Tokenizer() +.setInputCols("document") +.setOutputCol("token") + +val zeroShotClassifier = BartForSequenceClassification.pretrained("bart_large_zero_shot_classifier_mnli", "en") +.setInputCols("document", "token") +.setOutputCol("class") +.setCaseSensitive(true) +.setMaxSentenceLength(512) +.setCandidateLabels(Array("urgent", "mobile", "travel", "movie", "music", "sport", "weather", "technology")) + +val pipeline = new Pipeline().setStages(Array(document_assembler, tokenizer, zeroShotClassifier)) + +val example = Seq("I have a problem with my iphone that needs to be resolved asap!!").toDS.toDF("text") + +val result = pipeline.fit(example).transform(example) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bart_large_zero_shot_classifier_mnli| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[token, document]| +|Output Labels:|[label]| +|Language:|en| +|Size:|974.1 MB| +|Case sensitive:|true| + +## References + +https://huggingface.co/facebook/bart-large-mnli \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_en.md b/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_en.md new file mode 100644 index 00000000000000..2e99204cd058e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_base_peer_binloc T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_binloc +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_binloc` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_binloc_en_5.4.2_3.0_1724744287067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_binloc_en_5.4.2_3.0_1724744287067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_base_peer_binloc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_base_peer_binloc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_binloc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-binloc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_pipeline_en.md new file mode 100644 index 00000000000000..681413f2c2990c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-biot5_base_peer_binloc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_base_peer_binloc_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_base_peer_binloc_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_base_peer_binloc_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_base_peer_binloc_pipeline_en_5.4.2_3.0_1724744336257.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_base_peer_binloc_pipeline_en_5.4.2_3.0_1724744336257.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_base_peer_binloc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_base_peer_binloc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_base_peer_binloc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-base-peer-binloc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_en.md new file mode 100644 index 00000000000000..8a061fd69b96c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_large_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_2_en_5.4.2_3.0_1724743681267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_2_en_5.4.2_3.0_1724743681267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_large_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_large_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..eb292f5511ef0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_large_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_large_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724743862640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724743862640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_large_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_large_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_en.md new file mode 100644 index 00000000000000..730784c0da82d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_small_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_small_seed_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_small_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_1_en_5.4.2_3.0_1724768971161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_1_en_5.4.2_3.0_1724768971161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_small_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_small_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_small_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.1 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-small_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..ed8707aa5519ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-boolq_t5_small_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_small_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_small_seed_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_small_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724768994446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724768994446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_small_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_small_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_small_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.2 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-small_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_en.md new file mode 100644 index 00000000000000..4209b70c4502cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_parvathyip T5Transformer from parvathyip +author: John Snow Labs +name: burmese_awesome_billsum_model_parvathyip +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_parvathyip` is a English model originally trained by parvathyip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_parvathyip_en_5.4.2_3.0_1724762435234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_parvathyip_en_5.4.2_3.0_1724762435234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_parvathyip","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_parvathyip", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_parvathyip| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.8 MB| + +## References + +https://huggingface.co/parvathyip/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_pipeline_en.md new file mode 100644 index 00000000000000..65a790e6fc2b11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_parvathyip_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_parvathyip_pipeline pipeline T5Transformer from parvathyip +author: John Snow Labs +name: burmese_awesome_billsum_model_parvathyip_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_parvathyip_pipeline` is a English model originally trained by parvathyip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_parvathyip_pipeline_en_5.4.2_3.0_1724762457606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_parvathyip_pipeline_en_5.4.2_3.0_1724762457606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_parvathyip_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_parvathyip_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_parvathyip_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|317.9 MB| + +## References + +https://huggingface.co/parvathyip/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_en.md new file mode 100644 index 00000000000000..737717cd18f52f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_shen77 T5Transformer from shen77 +author: John Snow Labs +name: burmese_awesome_billsum_model_shen77 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_shen77` is a English model originally trained by shen77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_shen77_en_5.4.2_3.0_1724738378708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_shen77_en_5.4.2_3.0_1724738378708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_shen77","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_shen77", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_shen77| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/shen77/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_pipeline_en.md new file mode 100644 index 00000000000000..b0dedcb27cbc9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_billsum_model_shen77_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_shen77_pipeline pipeline T5Transformer from shen77 +author: John Snow Labs +name: burmese_awesome_billsum_model_shen77_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_shen77_pipeline` is a English model originally trained by shen77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_shen77_pipeline_en_5.4.2_3.0_1724738395499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_shen77_pipeline_en_5.4.2_3.0_1724738395499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_shen77_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_shen77_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_shen77_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/shen77/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_en.md new file mode 100644 index 00000000000000..561254aa51e91f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_modelllo T5Transformer from wiktorw +author: John Snow Labs +name: burmese_awesome_opus_books_modelllo +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_modelllo` is a English model originally trained by wiktorw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_en_5.4.2_3.0_1724768171468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_en_5.4.2_3.0_1724768171468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_modelllo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_modelllo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_modelllo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/wiktorw/my_awesome_opus_books_modelllo \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_pipeline_en.md new file mode 100644 index 00000000000000..8411c669ae7117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_awesome_opus_books_modelllo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_modelllo_pipeline pipeline T5Transformer from wiktorw +author: John Snow Labs +name: burmese_awesome_opus_books_modelllo_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_modelllo_pipeline` is a English model originally trained by wiktorw. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_pipeline_en_5.4.2_3.0_1724768195585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_modelllo_pipeline_en_5.4.2_3.0_1724768195585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_modelllo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_modelllo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_modelllo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.6 MB| + +## References + +https://huggingface.co/wiktorw/my_awesome_opus_books_modelllo + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_model_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_model_1_en.md new file mode 100644 index 00000000000000..d1f82541f49ab3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_model_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_model_1 T5Transformer from sheoran95 +author: John Snow Labs +name: burmese_model_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model_1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model_1_en_5.4.2_3.0_1724752949633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model_1_en_5.4.2_3.0_1724752949633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_model_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_model_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/sheoran95/my_model_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_en.md new file mode 100644 index 00000000000000..bfa675c6dabce9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_t5_model_nofuture37 T5Transformer from nofuture37 +author: John Snow Labs +name: burmese_t5_model_nofuture37 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_t5_model_nofuture37` is a English model originally trained by nofuture37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_t5_model_nofuture37_en_5.4.2_3.0_1724753057584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_t5_model_nofuture37_en_5.4.2_3.0_1724753057584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_t5_model_nofuture37","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_t5_model_nofuture37", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_t5_model_nofuture37| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|940.9 MB| + +## References + +https://huggingface.co/nofuture37/my_t5_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_pipeline_en.md new file mode 100644 index 00000000000000..88f6d75c2f04d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-burmese_t5_model_nofuture37_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_t5_model_nofuture37_pipeline pipeline T5Transformer from nofuture37 +author: John Snow Labs +name: burmese_t5_model_nofuture37_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_t5_model_nofuture37_pipeline` is a English model originally trained by nofuture37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_t5_model_nofuture37_pipeline_en_5.4.2_3.0_1724753129186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_t5_model_nofuture37_pipeline_en_5.4.2_3.0_1724753129186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_t5_model_nofuture37_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_t5_model_nofuture37_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_t5_model_nofuture37_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|940.9 MB| + +## References + +https://huggingface.co/nofuture37/my_t5_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_en.md new file mode 100644 index 00000000000000..fa053e68f9751e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cbt_flan_t5_model_3 T5Transformer from eaglewatch +author: John Snow Labs +name: cbt_flan_t5_model_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cbt_flan_t5_model_3` is a English model originally trained by eaglewatch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cbt_flan_t5_model_3_en_5.4.2_3.0_1724771322216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cbt_flan_t5_model_3_en_5.4.2_3.0_1724771322216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cbt_flan_t5_model_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cbt_flan_t5_model_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cbt_flan_t5_model_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eaglewatch/CBT_Flan_T5_model_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_pipeline_en.md new file mode 100644 index 00000000000000..8a77ef5195fdcf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cbt_flan_t5_model_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cbt_flan_t5_model_3_pipeline pipeline T5Transformer from eaglewatch +author: John Snow Labs +name: cbt_flan_t5_model_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cbt_flan_t5_model_3_pipeline` is a English model originally trained by eaglewatch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cbt_flan_t5_model_3_pipeline_en_5.4.2_3.0_1724771367927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cbt_flan_t5_model_3_pipeline_en_5.4.2_3.0_1724771367927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cbt_flan_t5_model_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cbt_flan_t5_model_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cbt_flan_t5_model_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eaglewatch/CBT_Flan_T5_model_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_en.md b/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_en.md new file mode 100644 index 00000000000000..a3ae82dcdc96e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English classification_flan_t5_base_enriched T5Transformer from sarahahtee +author: John Snow Labs +name: classification_flan_t5_base_enriched +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`classification_flan_t5_base_enriched` is a English model originally trained by sarahahtee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/classification_flan_t5_base_enriched_en_5.4.2_3.0_1724738603131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/classification_flan_t5_base_enriched_en_5.4.2_3.0_1724738603131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("classification_flan_t5_base_enriched","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("classification_flan_t5_base_enriched", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|classification_flan_t5_base_enriched| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sarahahtee/classification_flan_t5_base_enriched \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_pipeline_en.md new file mode 100644 index 00000000000000..e3bae77a451838 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-classification_flan_t5_base_enriched_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English classification_flan_t5_base_enriched_pipeline pipeline T5Transformer from sarahahtee +author: John Snow Labs +name: classification_flan_t5_base_enriched_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`classification_flan_t5_base_enriched_pipeline` is a English model originally trained by sarahahtee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/classification_flan_t5_base_enriched_pipeline_en_5.4.2_3.0_1724738651724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/classification_flan_t5_base_enriched_pipeline_en_5.4.2_3.0_1724738651724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("classification_flan_t5_base_enriched_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("classification_flan_t5_base_enriched_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|classification_flan_t5_base_enriched_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sarahahtee/classification_flan_t5_base_enriched + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_en.md new file mode 100644 index 00000000000000..bb325486565e39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting13_aspol T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting13_aspol +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting13_aspol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting13_aspol_en_5.4.2_3.0_1724753234617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting13_aspol_en_5.4.2_3.0_1724753234617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting13_aspol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting13_aspol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting13_aspol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting13_ASPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_pipeline_en.md new file mode 100644 index 00000000000000..856d2edb8fe710 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting13_aspol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting13_aspol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting13_aspol_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting13_aspol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting13_aspol_pipeline_en_5.4.2_3.0_1724753402050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting13_aspol_pipeline_en_5.4.2_3.0_1724753402050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting13_aspol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting13_aspol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting13_aspol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting13_ASPOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_en.md new file mode 100644 index 00000000000000..cc236c8993a1f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_en_5.4.2_3.0_1724725479192.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_en_5.4.2_3.0_1724725479192.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_paraphrase_F2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline_en.md new file mode 100644 index 00000000000000..0cf679061ed563 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline_en_5.4.2_3.0_1724725732060.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline_en_5.4.2_3.0_1724725732060.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_paraphrase_F2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en.md new file mode 100644 index 00000000000000..5fb0885126ff8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_label2text_augap1 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_label2text_augap1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_label2text_augap1` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en_5.4.2_3.0_1724757014583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en_5.4.2_3.0_1724757014583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_augap1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_augap1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_label2text_augap1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_label2text_AugAp1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_en.md new file mode 100644 index 00000000000000..d63f42b3239529 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oaspl T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oaspl +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oaspl` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_en_5.4.2_3.0_1724773232776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_en_5.4.2_3.0_1724773232776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oaspl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oaspl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oaspl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OASPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en.md new file mode 100644 index 00000000000000..103e001efb55f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oaspl_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oaspl_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oaspl_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en_5.4.2_3.0_1724773395787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en_5.4.2_3.0_1724773395787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oaspl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oaspl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oaspl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OASPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_en.md new file mode 100644 index 00000000000000..e0d370bb3c49f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_saopl T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_saopl +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_saopl` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_en_5.4.2_3.0_1724764636238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_en_5.4.2_3.0_1724764636238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_saopl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_saopl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_saopl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAOPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_pipeline_en.md new file mode 100644 index 00000000000000..2cba70c982fac0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_saopl_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_saopl_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_saopl_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_pipeline_en_5.4.2_3.0_1724764806194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_pipeline_en_5.4.2_3.0_1724764806194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_saopl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_saopl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_saopl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAOPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_en.md new file mode 100644 index 00000000000000..1bed1ee5a9b487 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_oapsl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_oapsl_v1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_oapsl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_oapsl_v1_en_5.4.2_3.0_1724757460025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_oapsl_v1_en_5.4.2_3.0_1724757460025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_oapsl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_oapsl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_oapsl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_OAPSL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en.md new file mode 100644 index 00000000000000..f550b5e7d6699f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en_5.4.2_3.0_1724757660558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en_5.4.2_3.0_1724757660558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_OAPSL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_en.md new file mode 100644 index 00000000000000..ac32dbba033a35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn3_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn3_soapl_v1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn3_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn3_soapl_v1_en_5.4.2_3.0_1724729169983.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn3_soapl_v1_en_5.4.2_3.0_1724729169983.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn3_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn3_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn3_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN3_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..8b4b3be85174b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline_en_5.4.2_3.0_1724729337543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline_en_5.4.2_3.0_1724729337543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn3_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN3_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_en.md new file mode 100644 index 00000000000000..0f63b93dfc909f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_pasol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_pasol_v1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_pasol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_pasol_v1_en_5.4.2_3.0_1724753774910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_pasol_v1_en_5.4.2_3.0_1724753774910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_pasol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_pasol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_pasol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_PASOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en.md new file mode 100644 index 00000000000000..871078c0695964 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en_5.4.2_3.0_1724753944233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en_5.4.2_3.0_1724753944233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_PASOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_en.md new file mode 100644 index 00000000000000..f04cd46f92bc8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_mvpcoqe_vit5_prompting5_top1_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_mvpcoqe_vit5_prompting5_top1_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_mvpcoqe_vit5_prompting5_top1_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_mvpcoqe_vit5_prompting5_top1_v2_en_5.4.2_3.0_1724733084922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_mvpcoqe_vit5_prompting5_top1_v2_en_5.4.2_3.0_1724733084922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_mvpcoqe_vit5_prompting5_top1_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_mvpcoqe_vit5_prompting5_top1_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_mvpcoqe_vit5_prompting5_top1_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_MvPCOQE_viT5_Prompting5_top1_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline_en.md new file mode 100644 index 00000000000000..154b0c3305fe8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline_en_5.4.2_3.0_1724733260495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline_en_5.4.2_3.0_1724733260495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_mvpcoqe_vit5_prompting5_top1_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_MvPCOQE_viT5_Prompting5_top1_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_en.md b/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_en.md new file mode 100644 index 00000000000000..4b3853af4f5f48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English debug_t5_small_squad T5Transformer from tiagoblima +author: John Snow Labs +name: debug_t5_small_squad +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`debug_t5_small_squad` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/debug_t5_small_squad_en_5.4.2_3.0_1724738414763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/debug_t5_small_squad_en_5.4.2_3.0_1724738414763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("debug_t5_small_squad","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("debug_t5_small_squad", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|debug_t5_small_squad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/tiagoblima/debug_t5-small_squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_pipeline_en.md new file mode 100644 index 00000000000000..9995c69a3e5bec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-debug_t5_small_squad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English debug_t5_small_squad_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: debug_t5_small_squad_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`debug_t5_small_squad_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/debug_t5_small_squad_pipeline_en_5.4.2_3.0_1724738434423.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/debug_t5_small_squad_pipeline_en_5.4.2_3.0_1724738434423.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("debug_t5_small_squad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("debug_t5_small_squad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|debug_t5_small_squad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/tiagoblima/debug_t5-small_squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_en.md new file mode 100644 index 00000000000000..c2ab3c5b43f118 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English derm_t5_small_1 T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small_1` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_1_en_5.4.2_3.0_1724763195881.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_1_en_5.4.2_3.0_1724763195881.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("derm_t5_small_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("derm_t5_small_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_pipeline_en.md new file mode 100644 index 00000000000000..7e1c6c7dd8a574 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-derm_t5_small_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English derm_t5_small_1_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small_1_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_1_pipeline_en_5.4.2_3.0_1724763216294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_1_pipeline_en_5.4.2_3.0_1724763216294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("derm_t5_small_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("derm_t5_small_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dfm_test_en.md b/docs/_posts/ahmedlone127/2024-08-27-dfm_test_en.md new file mode 100644 index 00000000000000..bc64e516dbd6e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dfm_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dfm_test T5Transformer from donmaclean +author: John Snow Labs +name: dfm_test +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dfm_test` is a English model originally trained by donmaclean. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dfm_test_en_5.4.2_3.0_1724749344532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dfm_test_en_5.4.2_3.0_1724749344532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dfm_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dfm_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dfm_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/donmaclean/dfm_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dfm_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-dfm_test_pipeline_en.md new file mode 100644 index 00000000000000..cf2a3581a82b25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dfm_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dfm_test_pipeline pipeline T5Transformer from donmaclean +author: John Snow Labs +name: dfm_test_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dfm_test_pipeline` is a English model originally trained by donmaclean. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dfm_test_pipeline_en_5.4.2_3.0_1724749390159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dfm_test_pipeline_en_5.4.2_3.0_1724749390159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dfm_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dfm_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dfm_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/donmaclean/dfm_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_en.md b/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_en.md new file mode 100644 index 00000000000000..ba3894d08fcbb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dgslow_t5_small_bst T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_bst +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_bst` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_en_5.4.2_3.0_1724739855771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_en_5.4.2_3.0_1724739855771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dgslow_t5_small_bst","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dgslow_t5_small_bst", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_bst| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.3 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_BST \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_pipeline_en.md new file mode 100644 index 00000000000000..802247307eda01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dgslow_t5_small_bst_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dgslow_t5_small_bst_pipeline pipeline T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_bst_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_bst_pipeline` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_pipeline_en_5.4.2_3.0_1724739876401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_bst_pipeline_en_5.4.2_3.0_1724739876401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dgslow_t5_small_bst_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dgslow_t5_small_bst_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_bst_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.3 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_BST + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_pipeline_zh.md new file mode 100644 index 00000000000000..273dc2ec9720b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese dialogue_summary_fill_characters_pipeline pipeline T5Transformer from svjack +author: John Snow Labs +name: dialogue_summary_fill_characters_pipeline +date: 2024-08-27 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary_fill_characters_pipeline` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_fill_characters_pipeline_zh_5.4.2_3.0_1724735422041.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_fill_characters_pipeline_zh_5.4.2_3.0_1724735422041.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialogue_summary_fill_characters_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialogue_summary_fill_characters_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary_fill_characters_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|983.1 MB| + +## References + +https://huggingface.co/svjack/dialogue-summary-fill-characters + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_zh.md b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_zh.md new file mode 100644 index 00000000000000..4961eba7862485 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fill_characters_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese dialogue_summary_fill_characters T5Transformer from svjack +author: John Snow Labs +name: dialogue_summary_fill_characters +date: 2024-08-27 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary_fill_characters` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_fill_characters_zh_5.4.2_3.0_1724735370715.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_fill_characters_zh_5.4.2_3.0_1724735370715.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialogue_summary_fill_characters","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialogue_summary_fill_characters", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary_fill_characters| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|983.1 MB| + +## References + +https://huggingface.co/svjack/dialogue-summary-fill-characters \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_en.md b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_en.md new file mode 100644 index 00000000000000..4055856dd90814 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialogue_summary_fine_tune_mem_test T5Transformer from eddieman78 +author: John Snow Labs +name: dialogue_summary_fine_tune_mem_test +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary_fine_tune_mem_test` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_fine_tune_mem_test_en_5.4.2_3.0_1724764516490.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_fine_tune_mem_test_en_5.4.2_3.0_1724764516490.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialogue_summary_fine_tune_mem_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialogue_summary_fine_tune_mem_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary_fine_tune_mem_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|178.9 MB| + +## References + +https://huggingface.co/eddieman78/dialogue-summary-fine-tune-mem-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_pipeline_en.md new file mode 100644 index 00000000000000..6596803b7fc7df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dialogue_summary_fine_tune_mem_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialogue_summary_fine_tune_mem_test_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: dialogue_summary_fine_tune_mem_test_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogue_summary_fine_tune_mem_test_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogue_summary_fine_tune_mem_test_pipeline_en_5.4.2_3.0_1724764576540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogue_summary_fine_tune_mem_test_pipeline_en_5.4.2_3.0_1724764576540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialogue_summary_fine_tune_mem_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialogue_summary_fine_tune_mem_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogue_summary_fine_tune_mem_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|178.9 MB| + +## References + +https://huggingface.co/eddieman78/dialogue-summary-fine-tune-mem-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_en.md new file mode 100644 index 00000000000000..469036e46b5062 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_5_en_5.4.2_3.0_1724743545635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_5_en_5.4.2_3.0_1724743545635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_pipeline_en.md new file mode 100644 index 00000000000000..cd9064cf0b15c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_010099_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_5_pipeline_en_5.4.2_3.0_1724743728711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_5_pipeline_en_5.4.2_3.0_1724743728711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_en.md new file mode 100644 index 00000000000000..f90fa8a9c3c07b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_1b0000 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1b0000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1b0000` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1b0000_en_5.4.2_3.0_1724770461343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1b0000_en_5.4.2_3.0_1724770461343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_1b0000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_1b0000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1b0000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1b0000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_pipeline_en.md new file mode 100644 index 00000000000000..cdb947c0b0af82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1b0000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_1b0000_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1b0000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1b0000_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1b0000_pipeline_en_5.4.2_3.0_1724770648350.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1b0000_pipeline_en_5.4.2_3.0_1724770648350.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_1b0000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_1b0000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1b0000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1b0000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_en.md new file mode 100644 index 00000000000000..832635c481d2e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_1t9901 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1t9901 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1t9901` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1t9901_en_5.4.2_3.0_1724748305443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1t9901_en_5.4.2_3.0_1724748305443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_1t9901","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_1t9901", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1t9901| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1t9901 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_pipeline_en.md new file mode 100644 index 00000000000000..1d841b9ff79981 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-distilled_mt5_small_1t9901_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_1t9901_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_1t9901_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_1t9901_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1t9901_pipeline_en_5.4.2_3.0_1724748493552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_1t9901_pipeline_en_5.4.2_3.0_1724748493552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_1t9901_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_1t9901_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_1t9901_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-1t9901 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_en.md b/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_en.md new file mode 100644 index 00000000000000..f6372ead8f40d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ds_chatbot_vit5_large T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_large +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_large` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_en_5.4.2_3.0_1724737595243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_en_5.4.2_3.0_1724737595243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ds_chatbot_vit5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ds_chatbot_vit5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_pipeline_en.md new file mode 100644 index 00000000000000..bca0c5e2dbbfdf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ds_chatbot_vit5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ds_chatbot_vit5_large_pipeline pipeline T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_large_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_large_pipeline` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_pipeline_en_5.4.2_3.0_1724737736898.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_pipeline_en_5.4.2_3.0_1724737736898.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ds_chatbot_vit5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ds_chatbot_vit5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_en.md b/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_en.md new file mode 100644 index 00000000000000..c0ca19cdd61bc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dsmlfinalproject_t5 T5Transformer from Lemoneggroll +author: John Snow Labs +name: dsmlfinalproject_t5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dsmlfinalproject_t5` is a English model originally trained by Lemoneggroll. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dsmlfinalproject_t5_en_5.4.2_3.0_1724766759753.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dsmlfinalproject_t5_en_5.4.2_3.0_1724766759753.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dsmlfinalproject_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dsmlfinalproject_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dsmlfinalproject_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|938.1 MB| + +## References + +https://huggingface.co/Lemoneggroll/DSMLfinalproject_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_pipeline_en.md new file mode 100644 index 00000000000000..df0eaf5bc43113 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dsmlfinalproject_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dsmlfinalproject_t5_pipeline pipeline T5Transformer from Lemoneggroll +author: John Snow Labs +name: dsmlfinalproject_t5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dsmlfinalproject_t5_pipeline` is a English model originally trained by Lemoneggroll. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dsmlfinalproject_t5_pipeline_en_5.4.2_3.0_1724766817512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dsmlfinalproject_t5_pipeline_en_5.4.2_3.0_1724766817512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dsmlfinalproject_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dsmlfinalproject_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dsmlfinalproject_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|938.1 MB| + +## References + +https://huggingface.co/Lemoneggroll/DSMLfinalproject_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_en.md new file mode 100644 index 00000000000000..39692f5430b0bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dutch_ge_dp_6bx5_3 T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_dp_6bx5_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_dp_6bx5_3` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_dp_6bx5_3_en_5.4.2_3.0_1724751000464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_dp_6bx5_3_en_5.4.2_3.0_1724751000464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dutch_ge_dp_6bx5_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dutch_ge_dp_6bx5_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_dp_6bx5_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_DP_6BX5_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_pipeline_en.md new file mode 100644 index 00000000000000..cf8b1c6bcf4705 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-dutch_ge_dp_6bx5_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dutch_ge_dp_6bx5_3_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: dutch_ge_dp_6bx5_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dutch_ge_dp_6bx5_3_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dutch_ge_dp_6bx5_3_pipeline_en_5.4.2_3.0_1724751151104.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dutch_ge_dp_6bx5_3_pipeline_en_5.4.2_3.0_1724751151104.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dutch_ge_dp_6bx5_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dutch_ge_dp_6bx5_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dutch_ge_dp_6bx5_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nl_ge_DP_6BX5_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-el16_en.md b/docs/_posts/ahmedlone127/2024-08-27-el16_en.md new file mode 100644 index 00000000000000..37208b700b18c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-el16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English el16 T5Transformer from Shitba +author: John Snow Labs +name: el16 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`el16` is a English model originally trained by Shitba. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/el16_en_5.4.2_3.0_1724749243666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/el16_en_5.4.2_3.0_1724749243666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("el16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("el16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|el16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|119.2 MB| + +## References + +https://huggingface.co/Shitba/El16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-el16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-el16_pipeline_en.md new file mode 100644 index 00000000000000..5d9d0c6361cd79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-el16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English el16_pipeline pipeline T5Transformer from Shitba +author: John Snow Labs +name: el16_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`el16_pipeline` is a English model originally trained by Shitba. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/el16_pipeline_en_5.4.2_3.0_1724749249614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/el16_pipeline_en_5.4.2_3.0_1724749249614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("el16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("el16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|el16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|119.2 MB| + +## References + +https://huggingface.co/Shitba/El16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-english_mt5_base_10_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-27-english_mt5_base_10_wikisql_en.md new file mode 100644 index 00000000000000..50e71627128d27 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-english_mt5_base_10_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_mt5_base_10_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_base_10_wikisql +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_base_10_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_base_10_wikisql_en_5.4.2_3.0_1724764071984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_base_10_wikisql_en_5.4.2_3.0_1724764071984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_mt5_base_10_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_mt5_base_10_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_base_10_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-base_10_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_en.md new file mode 100644 index 00000000000000..f886a0208ddc1c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5_small_5_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_5_wikisql +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_5_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_5_wikisql_en_5.4.2_3.0_1724728494959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_5_wikisql_en_5.4.2_3.0_1724728494959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5_small_5_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5_small_5_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_5_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.5 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_5_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_pipeline_en.md new file mode 100644 index 00000000000000..c8ab75131cf0fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-english_t5_small_5_wikisql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5_small_5_wikisql_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_5_wikisql_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_5_wikisql_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_5_wikisql_pipeline_en_5.4.2_3.0_1724728512910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_5_wikisql_pipeline_en_5.4.2_3.0_1724728512910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5_small_5_wikisql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5_small_5_wikisql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_5_wikisql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.5 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_5_wikiSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_en.md b/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_en.md new file mode 100644 index 00000000000000..c057fd42c8dd8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English errorfix_mpyt5e20 T5Transformer from NaoS2 +author: John Snow Labs +name: errorfix_mpyt5e20 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`errorfix_mpyt5e20` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/errorfix_mpyt5e20_en_5.4.2_3.0_1724740991311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/errorfix_mpyt5e20_en_5.4.2_3.0_1724740991311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("errorfix_mpyt5e20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("errorfix_mpyt5e20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|errorfix_mpyt5e20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NaoS2/errorfix_mpyt5e20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_pipeline_en.md new file mode 100644 index 00000000000000..db12a8a31e15c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-errorfix_mpyt5e20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English errorfix_mpyt5e20_pipeline pipeline T5Transformer from NaoS2 +author: John Snow Labs +name: errorfix_mpyt5e20_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`errorfix_mpyt5e20_pipeline` is a English model originally trained by NaoS2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/errorfix_mpyt5e20_pipeline_en_5.4.2_3.0_1724741158822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/errorfix_mpyt5e20_pipeline_en_5.4.2_3.0_1724741158822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("errorfix_mpyt5e20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("errorfix_mpyt5e20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|errorfix_mpyt5e20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NaoS2/errorfix_mpyt5e20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_en.md b/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_en.md new file mode 100644 index 00000000000000..6e6af50cdf5239 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fin_certificates T5Transformer from isoleucin +author: John Snow Labs +name: fin_certificates +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fin_certificates` is a English model originally trained by isoleucin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fin_certificates_en_5.4.2_3.0_1724757717568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fin_certificates_en_5.4.2_3.0_1724757717568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fin_certificates","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fin_certificates", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fin_certificates| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|292.1 MB| + +## References + +https://huggingface.co/isoleucin/fin-certificates \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_pipeline_en.md new file mode 100644 index 00000000000000..ed0ed9b8716fa6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fin_certificates_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fin_certificates_pipeline pipeline T5Transformer from isoleucin +author: John Snow Labs +name: fin_certificates_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fin_certificates_pipeline` is a English model originally trained by isoleucin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fin_certificates_pipeline_en_5.4.2_3.0_1724757748561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fin_certificates_pipeline_en_5.4.2_3.0_1724757748561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fin_certificates_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fin_certificates_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fin_certificates_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|292.1 MB| + +## References + +https://huggingface.co/isoleucin/fin-certificates + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_en.md b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_en.md new file mode 100644 index 00000000000000..80f2c9bf77cba5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_t5_model_luminoria T5Transformer from luminoria +author: John Snow Labs +name: fine_tuned_t5_model_luminoria +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_t5_model_luminoria` is a English model originally trained by luminoria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_model_luminoria_en_5.4.2_3.0_1724758619729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_model_luminoria_en_5.4.2_3.0_1724758619729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_t5_model_luminoria","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_t5_model_luminoria", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_t5_model_luminoria| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.9 MB| + +## References + +https://huggingface.co/luminoria/fine_tuned_t5_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_pipeline_en.md new file mode 100644 index 00000000000000..46321e796b62a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_model_luminoria_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fine_tuned_t5_model_luminoria_pipeline pipeline T5Transformer from luminoria +author: John Snow Labs +name: fine_tuned_t5_model_luminoria_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_t5_model_luminoria_pipeline` is a English model originally trained by luminoria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_model_luminoria_pipeline_en_5.4.2_3.0_1724758640968.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_model_luminoria_pipeline_en_5.4.2_3.0_1724758640968.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fine_tuned_t5_model_luminoria_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fine_tuned_t5_model_luminoria_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_t5_model_luminoria_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.0 MB| + +## References + +https://huggingface.co/luminoria/fine_tuned_t5_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_en.md b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_en.md new file mode 100644 index 00000000000000..c087bf05959c7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_t5_small_model T5Transformer from Abhi3127 +author: John Snow Labs +name: fine_tuned_t5_small_model +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_t5_small_model` is a English model originally trained by Abhi3127. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_small_model_en_5.4.2_3.0_1724733472995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_small_model_en_5.4.2_3.0_1724733472995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_t5_small_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_t5_small_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_t5_small_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/Abhi3127/fine_tuned_t5_small_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_pipeline_en.md new file mode 100644 index 00000000000000..97fc92e21a6fe2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-fine_tuned_t5_small_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fine_tuned_t5_small_model_pipeline pipeline T5Transformer from Abhi3127 +author: John Snow Labs +name: fine_tuned_t5_small_model_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_t5_small_model_pipeline` is a English model originally trained by Abhi3127. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_small_model_pipeline_en_5.4.2_3.0_1724733494639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_t5_small_model_pipeline_en_5.4.2_3.0_1724733494639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fine_tuned_t5_small_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fine_tuned_t5_small_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_t5_small_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/Abhi3127/fine_tuned_t5_small_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_en.md new file mode 100644 index 00000000000000..2b34c107464195 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver_augmented2 T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver_augmented2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver_augmented2` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver_augmented2_en_5.4.2_3.0_1724742148704.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver_augmented2_en_5.4.2_3.0_1724742148704.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver_augmented2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_newwiki_summarization_ver_augmented2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver_augmented2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver-augmented2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_pipeline_en.md new file mode 100644 index 00000000000000..a52eb2c0a08b87 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_newwiki_summarization_ver_augmented2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_newwiki_summarization_ver_augmented2_pipeline pipeline T5Transformer from minnehwg +author: John Snow Labs +name: finetune_newwiki_summarization_ver_augmented2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_newwiki_summarization_ver_augmented2_pipeline` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver_augmented2_pipeline_en_5.4.2_3.0_1724742198608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_newwiki_summarization_ver_augmented2_pipeline_en_5.4.2_3.0_1724742198608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_newwiki_summarization_ver_augmented2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_newwiki_summarization_ver_augmented2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_newwiki_summarization_ver_augmented2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetune-newwiki-summarization-ver-augmented2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..3e47790be3ead0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_qa_t5_small_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_qa_t5_small_standard_bahasa_cased +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_qa_t5_small_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_qa_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724750774556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_qa_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724750774556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_qa_t5_small_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_qa_t5_small_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_qa_t5_small_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/mesolitica/finetune-qa-t5-small-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..51b7732bf23fae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_qa_t5_small_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_qa_t5_small_standard_bahasa_cased_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_qa_t5_small_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_qa_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724750790532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_qa_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724750790532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_qa_t5_small_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_qa_t5_small_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_qa_t5_small_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/mesolitica/finetune-qa-t5-small-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..e63c0b1823ce4a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_true_case_t5_super_tiny_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_true_case_t5_super_tiny_standard_bahasa_cased +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_true_case_t5_super_tiny_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_super_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724741496925.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_super_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724741496925.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_true_case_t5_super_tiny_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_true_case_t5_super_tiny_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_true_case_t5_super_tiny_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|109.5 MB| + +## References + +https://huggingface.co/mesolitica/finetune-true-case-t5-super-tiny-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..47cabcdfda7609 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724741502312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724741502312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_true_case_t5_super_tiny_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|109.5 MB| + +## References + +https://huggingface.co/mesolitica/finetune-true-case-t5-super-tiny-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_en.md new file mode 100644 index 00000000000000..ec15bc17a55563 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_mt5_anujsahani01 T5Transformer from anujsahani01 +author: John Snow Labs +name: finetuned_mt5_anujsahani01 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_anujsahani01` is a English model originally trained by anujsahani01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_anujsahani01_en_5.4.2_3.0_1724719237955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_anujsahani01_en_5.4.2_3.0_1724719237955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_mt5_anujsahani01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_mt5_anujsahani01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_anujsahani01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/anujsahani01/finetuned_mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_pipeline_en.md new file mode 100644 index 00000000000000..b00b22d1dc5a5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-finetuned_mt5_anujsahani01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_mt5_anujsahani01_pipeline pipeline T5Transformer from anujsahani01 +author: John Snow Labs +name: finetuned_mt5_anujsahani01_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_anujsahani01_pipeline` is a English model originally trained by anujsahani01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_anujsahani01_pipeline_en_5.4.2_3.0_1724719371731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_anujsahani01_pipeline_en_5.4.2_3.0_1724719371731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_mt5_anujsahani01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_mt5_anujsahani01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_anujsahani01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/anujsahani01/finetuned_mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_en.md new file mode 100644 index 00000000000000..c662bb4912a01a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_base_req_extractor T5Transformer from divers +author: John Snow Labs +name: flan_base_req_extractor +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_base_req_extractor` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_base_req_extractor_en_5.4.2_3.0_1724750329608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_base_req_extractor_en_5.4.2_3.0_1724750329608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_base_req_extractor","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_base_req_extractor", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_base_req_extractor| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/divers/flan-base-req-extractor \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_pipeline_en.md new file mode 100644 index 00000000000000..8517fe67dc013c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_base_req_extractor_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_base_req_extractor_pipeline pipeline T5Transformer from divers +author: John Snow Labs +name: flan_base_req_extractor_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_base_req_extractor_pipeline` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_base_req_extractor_pipeline_en_5.4.2_3.0_1724750376643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_base_req_extractor_pipeline_en_5.4.2_3.0_1724750376643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_base_req_extractor_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_base_req_extractor_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_base_req_extractor_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/divers/flan-base-req-extractor + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_en.md new file mode 100644 index 00000000000000..febd4db38abce5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_churnescalation_classification T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_churnescalation_classification +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_churnescalation_classification` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_churnescalation_classification_en_5.4.2_3.0_1724726286669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_churnescalation_classification_en_5.4.2_3.0_1724726286669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_churnescalation_classification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_churnescalation_classification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_churnescalation_classification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-churnescalation-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_pipeline_en.md new file mode 100644 index 00000000000000..22e8bb455f215d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_churnescalation_classification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_churnescalation_classification_pipeline pipeline T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_churnescalation_classification_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_churnescalation_classification_pipeline` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_churnescalation_classification_pipeline_en_5.4.2_3.0_1724726331920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_churnescalation_classification_pipeline_en_5.4.2_3.0_1724726331920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_churnescalation_classification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_churnescalation_classification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_churnescalation_classification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-churnescalation-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_en.md new file mode 100644 index 00000000000000..5b784257fa10e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_poll_generation T5Transformer from Pedrambbk +author: John Snow Labs +name: flan_t5_base_poll_generation +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_poll_generation` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_poll_generation_en_5.4.2_3.0_1724761166372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_poll_generation_en_5.4.2_3.0_1724761166372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_poll_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_poll_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_poll_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Pedrambbk/flan-t5-base-poll-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_pipeline_en.md new file mode 100644 index 00000000000000..85f983582cff1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_poll_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_poll_generation_pipeline pipeline T5Transformer from Pedrambbk +author: John Snow Labs +name: flan_t5_base_poll_generation_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_poll_generation_pipeline` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_poll_generation_pipeline_en_5.4.2_3.0_1724761216537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_poll_generation_pipeline_en_5.4.2_3.0_1724761216537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_poll_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_poll_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_poll_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Pedrambbk/flan-t5-base-poll-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_en.md new file mode 100644 index 00000000000000..5470d981573764 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_starwars T5Transformer from robvanderg +author: John Snow Labs +name: flan_t5_base_starwars +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_starwars` is a English model originally trained by robvanderg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_starwars_en_5.4.2_3.0_1724757462177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_starwars_en_5.4.2_3.0_1724757462177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_starwars","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_starwars", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_starwars| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/robvanderg/flan-t5-base-starwars \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_pipeline_en.md new file mode 100644 index 00000000000000..b97b29a4ddd4a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_starwars_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_starwars_pipeline pipeline T5Transformer from robvanderg +author: John Snow Labs +name: flan_t5_base_starwars_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_starwars_pipeline` is a English model originally trained by robvanderg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_starwars_pipeline_en_5.4.2_3.0_1724757509253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_starwars_pipeline_en_5.4.2_3.0_1724757509253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_starwars_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_starwars_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_starwars_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/robvanderg/flan-t5-base-starwars + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_en.md new file mode 100644 index 00000000000000..e681ecc68f2c74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_emoji T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_emoji +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_emoji` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_emoji_en_5.4.2_3.0_1724723210096.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_emoji_en_5.4.2_3.0_1724723210096.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_emoji","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_emoji", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_emoji| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-emoji \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_pipeline_en.md new file mode 100644 index 00000000000000..343a9b7bd5b73b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_base_tweet_emoji_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_emoji_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_emoji_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_emoji_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_emoji_pipeline_en_5.4.2_3.0_1724723260514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_emoji_pipeline_en_5.4.2_3.0_1724723260514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_emoji_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_emoji_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_emoji_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-emoji + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_en.md new file mode 100644 index 00000000000000..fa53e1d57e19b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_alt_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_alt_w_context_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_alt_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_w_context_small_en_5.4.2_3.0_1724761726353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_w_context_small_en_5.4.2_3.0_1724761726353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_alt_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_alt_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_alt_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-alt-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..1703cccf364bde --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_alt_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_alt_w_context_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_alt_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_w_context_small_pipeline_en_5.4.2_3.0_1724761742885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_alt_w_context_small_pipeline_en_5.4.2_3.0_1724761742885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_cbp_lkg_alt_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_cbp_lkg_alt_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_alt_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-alt-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_en.md new file mode 100644 index 00000000000000..18dd0697bbccb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr5e_4 T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr5e_4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr5e_4` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr5e_4_en_5.4.2_3.0_1724749779518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr5e_4_en_5.4.2_3.0_1724749779518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr5e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_glue_finetuning_lr5e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr5e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr5e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_pipeline_en.md new file mode 100644 index 00000000000000..20149e7f104ce1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_glue_finetuning_lr5e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_glue_finetuning_lr5e_4_pipeline pipeline T5Transformer from liuyanchen1015 +author: John Snow Labs +name: flan_t5_glue_finetuning_lr5e_4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_glue_finetuning_lr5e_4_pipeline` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr5e_4_pipeline_en_5.4.2_3.0_1724749825977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_glue_finetuning_lr5e_4_pipeline_en_5.4.2_3.0_1724749825977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_glue_finetuning_lr5e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_glue_finetuning_lr5e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_glue_finetuning_lr5e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/FLAN-T5_GLUE_finetuning_lr5e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_en.md new file mode 100644 index 00000000000000..564b23dc8f41f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large__multiple_choice T5Transformer from lvcalucioli +author: John Snow Labs +name: flan_t5_large__multiple_choice +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large__multiple_choice` is a English model originally trained by lvcalucioli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large__multiple_choice_en_5.4.2_3.0_1724765960959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large__multiple_choice_en_5.4.2_3.0_1724765960959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large__multiple_choice","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large__multiple_choice", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large__multiple_choice| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lvcalucioli/flan-t5-large__multiple-choice \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_pipeline_en.md new file mode 100644 index 00000000000000..ccedb5be2c2b3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large__multiple_choice_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large__multiple_choice_pipeline pipeline T5Transformer from lvcalucioli +author: John Snow Labs +name: flan_t5_large__multiple_choice_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large__multiple_choice_pipeline` is a English model originally trained by lvcalucioli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large__multiple_choice_pipeline_en_5.4.2_3.0_1724766099495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large__multiple_choice_pipeline_en_5.4.2_3.0_1724766099495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large__multiple_choice_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large__multiple_choice_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large__multiple_choice_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lvcalucioli/flan-t5-large__multiple-choice + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_en.md new file mode 100644 index 00000000000000..1104fa1843bc2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_analogy_nell T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_large_analogy_nell +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_analogy_nell` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_nell_en_5.4.2_3.0_1724747234601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_nell_en_5.4.2_3.0_1724747234601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_analogy_nell","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_analogy_nell", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_analogy_nell| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-large-analogy-nell \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_pipeline_en.md new file mode 100644 index 00000000000000..1cf735aff294f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_analogy_nell_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_analogy_nell_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_large_analogy_nell_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_analogy_nell_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_nell_pipeline_en_5.4.2_3.0_1724747376107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_nell_pipeline_en_5.4.2_3.0_1724747376107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_analogy_nell_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_analogy_nell_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_analogy_nell_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-large-analogy-nell + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_en.md new file mode 100644 index 00000000000000..1ad11b477206f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_en_5.4.2_3.0_1724733567294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_en_5.4.2_3.0_1724733567294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep11-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..b032612111f47e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline_en_5.4.2_3.0_1724733716571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline_en_5.4.2_3.0_1724733716571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_ep11_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-ep11-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_en.md new file mode 100644 index 00000000000000..a5380d082a34f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_fs0_05 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_fs0_05 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_fs0_05` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_fs0_05_en_5.4.2_3.0_1724736324253.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_fs0_05_en_5.4.2_3.0_1724736324253.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_fs0_05","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_fs0_05", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_fs0_05| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_fs0.05 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline_en.md new file mode 100644 index 00000000000000..3ab17cc4fe783e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline_en_5.4.2_3.0_1724736461617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline_en_5.4.2_3.0_1724736461617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_fs0_05_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_fs0.05 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_en.md new file mode 100644 index 00000000000000..ae38cfe52b5792 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnn_4000_ep10_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnn_4000_ep10_nonstop +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnn_4000_ep10_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_en_5.4.2_3.0_1724718896936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_en_5.4.2_3.0_1724718896936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnn_4000_ep10_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnn_4000_ep10_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnn_4000_ep10_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnn_4000-ep10-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..5c5337c3e335c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline_en_5.4.2_3.0_1724719048174.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline_en_5.4.2_3.0_1724719048174.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnn_4000_ep10_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnn_4000-ep10-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_en.md new file mode 100644 index 00000000000000..548bc4fbbd9a71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_summary T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_summary +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_summary` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_summary_en_5.4.2_3.0_1724724479292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_summary_en_5.4.2_3.0_1724724479292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_summary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_summary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_summary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-summary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_pipeline_en.md new file mode 100644 index 00000000000000..36f406868f92fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_extraction_cnndm_2000_summary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_summary_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_summary_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_summary_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_summary_pipeline_en_5.4.2_3.0_1724724619080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_summary_pipeline_en_5.4.2_3.0_1724724619080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_summary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_summary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_summary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-summary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_en.md new file mode 100644 index 00000000000000..314e0af0611947 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_fce_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_fce_e8_b16 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fce_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fce_e8_b16_en_5.4.2_3.0_1724730982058.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fce_e8_b16_en_5.4.2_3.0_1724730982058.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_fce_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_fce_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fce_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-fce-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..7eea56c94dfc2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fce_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_fce_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_fce_e8_b16_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fce_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fce_e8_b16_pipeline_en_5.4.2_3.0_1724731122395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fce_e8_b16_pipeline_en_5.4.2_3.0_1724731122395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_fce_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_fce_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fce_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-fce-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fold_0_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fold_0_en.md new file mode 100644 index 00000000000000..bdff04ada0080c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_large_fold_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_fold_0 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_large_fold_0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_fold_0` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_0_en_5.4.2_3.0_1724739506803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_fold_0_en_5.4.2_3.0_1724739506803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_fold_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_fold_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_fold_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-large_fold_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_en.md new file mode 100644 index 00000000000000..09be070ccdbc93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_all_kongo_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_all_kongo_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_all_kongo_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_small_en_5.4.2_3.0_1724773606038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_small_en_5.4.2_3.0_1724773606038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_all_kongo_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_all_kongo_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_all_kongo_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-all-kg-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_pipeline_en.md new file mode 100644 index 00000000000000..58623bc670dd15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_retacred_all_kongo_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_all_kongo_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_all_kongo_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_all_kongo_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_small_pipeline_en_5.4.2_3.0_1724773622512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_small_pipeline_en_5.4.2_3.0_1724773622512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_all_kongo_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_all_kongo_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_all_kongo_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-all-kg-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_en.md new file mode 100644 index 00000000000000..12dc0824397a11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_amazon_reviews_multi_yutaizhou T5Transformer from yutaizhou +author: John Snow Labs +name: flan_t5_small_amazon_reviews_multi_yutaizhou +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_amazon_reviews_multi_yutaizhou` is a English model originally trained by yutaizhou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_amazon_reviews_multi_yutaizhou_en_5.4.2_3.0_1724728340948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_amazon_reviews_multi_yutaizhou_en_5.4.2_3.0_1724728340948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_amazon_reviews_multi_yutaizhou","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_amazon_reviews_multi_yutaizhou", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_amazon_reviews_multi_yutaizhou| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/yutaizhou/flan-t5-small-amazon_reviews_multi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline_en.md new file mode 100644 index 00000000000000..ca90e734551f3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline pipeline T5Transformer from yutaizhou +author: John Snow Labs +name: flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline` is a English model originally trained by yutaizhou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline_en_5.4.2_3.0_1724728357247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline_en_5.4.2_3.0_1724728357247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_amazon_reviews_multi_yutaizhou_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/yutaizhou/flan-t5-small-amazon_reviews_multi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_en.md new file mode 100644 index 00000000000000..7ce6b7c9312d9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f0_punjabi_eastern T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f0_punjabi_eastern +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f0_punjabi_eastern` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f0_punjabi_eastern_en_5.4.2_3.0_1724772041445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f0_punjabi_eastern_en_5.4.2_3.0_1724772041445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f0_punjabi_eastern","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f0_punjabi_eastern", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f0_punjabi_eastern| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f0_pa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en.md new file mode 100644 index 00000000000000..f012601fdaeb68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en_5.4.2_3.0_1724772058651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en_5.4.2_3.0_1724772058651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f0_pa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_en.md new file mode 100644 index 00000000000000..a6e7858bce1519 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_insight0 T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_insight0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_insight0` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_insight0_en_5.4.2_3.0_1724768520666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_insight0_en_5.4.2_3.0_1724768520666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_insight0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_insight0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_insight0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-insight0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_pipeline_en.md new file mode 100644 index 00000000000000..87b6143b7a9509 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_insight0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_insight0_pipeline pipeline T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_insight0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_insight0_pipeline` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_insight0_pipeline_en_5.4.2_3.0_1724768537103.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_insight0_pipeline_en_5.4.2_3.0_1724768537103.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_insight0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_insight0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_insight0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small-insight0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_en.md new file mode 100644 index 00000000000000..e497cb2c92c1e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_temova T5Transformer from temova +author: John Snow Labs +name: flan_t5_small_samsum_temova +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_temova` is a English model originally trained by temova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_temova_en_5.4.2_3.0_1724758618048.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_temova_en_5.4.2_3.0_1724758618048.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_temova","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_temova", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_temova| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/temova/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_pipeline_en.md new file mode 100644 index 00000000000000..71256093437278 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_small_samsum_temova_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_temova_pipeline pipeline T5Transformer from temova +author: John Snow Labs +name: flan_t5_small_samsum_temova_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_temova_pipeline` is a English model originally trained by temova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_temova_pipeline_en_5.4.2_3.0_1724758635940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_temova_pipeline_en_5.4.2_3.0_1724758635940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_temova_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_temova_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_temova_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/temova/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_en.md new file mode 100644 index 00000000000000..82d8e1b8ba2425 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_mlm_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_mlm_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_mlm_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_small_en_5.4.2_3.0_1724772745533.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_small_en_5.4.2_3.0_1724772745533.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_mlm_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_mlm_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_mlm_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-mlm-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_pipeline_en.md new file mode 100644 index 00000000000000..86fb3a93d589d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-flan_t5_tacred_kongo_mlm_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_mlm_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_mlm_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_mlm_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_small_pipeline_en_5.4.2_3.0_1724772762092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_mlm_small_pipeline_en_5.4.2_3.0_1724772762092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_tacred_kongo_mlm_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_tacred_kongo_mlm_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_mlm_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-mlm-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_en.md b/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_en.md new file mode 100644 index 00000000000000..0543d951a20fbb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English formal_tonga_tonga_islands_informal T5Transformer from jaimin +author: John Snow Labs +name: formal_tonga_tonga_islands_informal +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`formal_tonga_tonga_islands_informal` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/formal_tonga_tonga_islands_informal_en_5.4.2_3.0_1724772682708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/formal_tonga_tonga_islands_informal_en_5.4.2_3.0_1724772682708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("formal_tonga_tonga_islands_informal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("formal_tonga_tonga_islands_informal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|formal_tonga_tonga_islands_informal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaimin/formal_to_informal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_pipeline_en.md new file mode 100644 index 00000000000000..7516a2827e91a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-formal_tonga_tonga_islands_informal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English formal_tonga_tonga_islands_informal_pipeline pipeline T5Transformer from jaimin +author: John Snow Labs +name: formal_tonga_tonga_islands_informal_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`formal_tonga_tonga_islands_informal_pipeline` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/formal_tonga_tonga_islands_informal_pipeline_en_5.4.2_3.0_1724772730666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/formal_tonga_tonga_islands_informal_pipeline_en_5.4.2_3.0_1724772730666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("formal_tonga_tonga_islands_informal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("formal_tonga_tonga_islands_informal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|formal_tonga_tonga_islands_informal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jaimin/formal_to_informal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_en.md b/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_en.md new file mode 100644 index 00000000000000..f5dfcf5f7d66f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500 T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_en_5.4.2_3.0_1724724246065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_en_5.4.2_3.0_1724724246065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_3hop_top3_COLBERT_multihop_checkpoint-109500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline_en.md new file mode 100644 index 00000000000000..5a6490b51edb8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline_en_5.4.2_3.0_1724724394632.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline_en_5.4.2_3.0_1724724394632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_3hop_top3_colbert_multihop_checkpoint_109500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_3hop_top3_COLBERT_multihop_checkpoint-109500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_en.md b/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_en.md new file mode 100644 index 00000000000000..190b0985cf71e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_t5_small_with_opusbook T5Transformer from aisuko +author: John Snow Labs +name: ft_t5_small_with_opusbook +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_t5_small_with_opusbook` is a English model originally trained by aisuko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_t5_small_with_opusbook_en_5.4.2_3.0_1724729840345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_t5_small_with_opusbook_en_5.4.2_3.0_1724729840345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_t5_small_with_opusbook","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_t5_small_with_opusbook", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_t5_small_with_opusbook| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.9 MB| + +## References + +https://huggingface.co/aisuko/ft-t5-small-with-opusbook \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_pipeline_en.md new file mode 100644 index 00000000000000..aeac1a7ddee711 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ft_t5_small_with_opusbook_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_t5_small_with_opusbook_pipeline pipeline T5Transformer from aisuko +author: John Snow Labs +name: ft_t5_small_with_opusbook_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_t5_small_with_opusbook_pipeline` is a English model originally trained by aisuko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_t5_small_with_opusbook_pipeline_en_5.4.2_3.0_1724729864179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_t5_small_with_opusbook_pipeline_en_5.4.2_3.0_1724729864179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_t5_small_with_opusbook_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_t5_small_with_opusbook_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_t5_small_with_opusbook_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.9 MB| + +## References + +https://huggingface.co/aisuko/ft-t5-small-with-opusbook + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_en.md b/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_en.md new file mode 100644 index 00000000000000..945a9a62cf9175 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English goodgletfbasedialogsummaryv1 T5Transformer from gvlk +author: John Snow Labs +name: goodgletfbasedialogsummaryv1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`goodgletfbasedialogsummaryv1` is a English model originally trained by gvlk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1_en_5.4.2_3.0_1724720698601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1_en_5.4.2_3.0_1724720698601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("goodgletfbasedialogsummaryv1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("goodgletfbasedialogsummaryv1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|goodgletfbasedialogsummaryv1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|518.9 MB| + +## References + +https://huggingface.co/gvlk/goodgletfbasedialogsummaryv1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_pipeline_en.md new file mode 100644 index 00000000000000..d96be423bbd108 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-goodgletfbasedialogsummaryv1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English goodgletfbasedialogsummaryv1_pipeline pipeline T5Transformer from gvlk +author: John Snow Labs +name: goodgletfbasedialogsummaryv1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`goodgletfbasedialogsummaryv1_pipeline` is a English model originally trained by gvlk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1_pipeline_en_5.4.2_3.0_1724720879366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1_pipeline_en_5.4.2_3.0_1724720879366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("goodgletfbasedialogsummaryv1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("goodgletfbasedialogsummaryv1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|goodgletfbasedialogsummaryv1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|518.9 MB| + +## References + +https://huggingface.co/gvlk/goodgletfbasedialogsummaryv1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_en.md new file mode 100644 index 00000000000000..14203de79f74d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_corrector_v2 T5Transformer from sanjay-m1 +author: John Snow Labs +name: grammar_corrector_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_corrector_v2` is a English model originally trained by sanjay-m1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_corrector_v2_en_5.4.2_3.0_1724770705361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_corrector_v2_en_5.4.2_3.0_1724770705361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_corrector_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_corrector_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_corrector_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sanjay-m1/grammar-corrector-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_pipeline_en.md new file mode 100644 index 00000000000000..ca4c47cd97f1ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-grammar_corrector_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_corrector_v2_pipeline pipeline T5Transformer from sanjay-m1 +author: John Snow Labs +name: grammar_corrector_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_corrector_v2_pipeline` is a English model originally trained by sanjay-m1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_corrector_v2_pipeline_en_5.4.2_3.0_1724770763435.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_corrector_v2_pipeline_en_5.4.2_3.0_1724770763435.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_corrector_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_corrector_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_corrector_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sanjay-m1/grammar-corrector-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_en.md b/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_en.md new file mode 100644 index 00000000000000..7889187c3ad671 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English greek_mt5_4ep_512 T5Transformer from chaido13 +author: John Snow Labs +name: greek_mt5_4ep_512 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`greek_mt5_4ep_512` is a English model originally trained by chaido13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_512_en_5.4.2_3.0_1724742018973.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_512_en_5.4.2_3.0_1724742018973.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("greek_mt5_4ep_512","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("greek_mt5_4ep_512", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|greek_mt5_4ep_512| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chaido13/greek-mt5-4ep-512 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_pipeline_en.md new file mode 100644 index 00000000000000..2bc1219a468892 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-greek_mt5_4ep_512_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English greek_mt5_4ep_512_pipeline pipeline T5Transformer from chaido13 +author: John Snow Labs +name: greek_mt5_4ep_512_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`greek_mt5_4ep_512_pipeline` is a English model originally trained by chaido13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_512_pipeline_en_5.4.2_3.0_1724742292038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_512_pipeline_en_5.4.2_3.0_1724742292038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("greek_mt5_4ep_512_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("greek_mt5_4ep_512_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|greek_mt5_4ep_512_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chaido13/greek-mt5-4ep-512 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_en.md b/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_en.md new file mode 100644 index 00000000000000..f6bdeb65e3313f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gsg_t5_model T5Transformer from naimur900 +author: John Snow Labs +name: gsg_t5_model +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gsg_t5_model` is a English model originally trained by naimur900. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gsg_t5_model_en_5.4.2_3.0_1724733276956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gsg_t5_model_en_5.4.2_3.0_1724733276956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gsg_t5_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gsg_t5_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gsg_t5_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.2 MB| + +## References + +https://huggingface.co/naimur900/gsg_t5_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_pipeline_en.md new file mode 100644 index 00000000000000..59b2192a96eca8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-gsg_t5_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gsg_t5_model_pipeline pipeline T5Transformer from naimur900 +author: John Snow Labs +name: gsg_t5_model_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gsg_t5_model_pipeline` is a English model originally trained by naimur900. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gsg_t5_model_pipeline_en_5.4.2_3.0_1724733294133.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gsg_t5_model_pipeline_en_5.4.2_3.0_1724733294133.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gsg_t5_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gsg_t5_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gsg_t5_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.2 MB| + +## References + +https://huggingface.co/naimur900/gsg_t5_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-hoaih_en.md b/docs/_posts/ahmedlone127/2024-08-27-hoaih_en.md new file mode 100644 index 00000000000000..6dc6e9159b2f9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-hoaih_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English hoaih T5Transformer from hHoai +author: John Snow Labs +name: hoaih +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hoaih` is a English model originally trained by hHoai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hoaih_en_5.4.2_3.0_1724722289389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hoaih_en_5.4.2_3.0_1724722289389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("hoaih","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("hoaih", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hoaih| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hHoai/hoaih \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-hoaih_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-hoaih_pipeline_en.md new file mode 100644 index 00000000000000..3a327ff7c2c046 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-hoaih_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English hoaih_pipeline pipeline T5Transformer from hHoai +author: John Snow Labs +name: hoaih_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`hoaih_pipeline` is a English model originally trained by hHoai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/hoaih_pipeline_en_5.4.2_3.0_1724722337574.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/hoaih_pipeline_en_5.4.2_3.0_1724722337574.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("hoaih_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("hoaih_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|hoaih_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hHoai/hoaih + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..c4e7e39ac6c10c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English imdb_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_base_seed_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_base_seed_3_en_5.4.2_3.0_1724735376418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_base_seed_3_en_5.4.2_3.0_1724735376418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("imdb_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("imdb_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.5 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..06b4f2e742e6d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English imdb_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_base_seed_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724735433934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724735433934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("imdb_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("imdb_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.5 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_large_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_large_seed_1_en.md new file mode 100644 index 00000000000000..e74f823519eb0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-imdb_t5_large_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English imdb_t5_large_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_large_seed_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_large_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_1_en_5.4.2_3.0_1724774946746.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_large_seed_1_en_5.4.2_3.0_1724774946746.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("imdb_t5_large_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("imdb_t5_large_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_large_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-large_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_en.md b/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_en.md new file mode 100644 index 00000000000000..e57115623d6ec9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ingredient_prune T5Transformer from AkshayPM +author: John Snow Labs +name: ingredient_prune +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ingredient_prune` is a English model originally trained by AkshayPM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ingredient_prune_en_5.4.2_3.0_1724728813726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ingredient_prune_en_5.4.2_3.0_1724728813726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ingredient_prune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ingredient_prune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ingredient_prune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|957.6 MB| + +## References + +https://huggingface.co/AkshayPM/ingredient_prune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_pipeline_en.md new file mode 100644 index 00000000000000..61249620bcc369 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ingredient_prune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ingredient_prune_pipeline pipeline T5Transformer from AkshayPM +author: John Snow Labs +name: ingredient_prune_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ingredient_prune_pipeline` is a English model originally trained by AkshayPM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ingredient_prune_pipeline_en_5.4.2_3.0_1724728871614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ingredient_prune_pipeline_en_5.4.2_3.0_1724728871614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ingredient_prune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ingredient_prune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ingredient_prune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|957.6 MB| + +## References + +https://huggingface.co/AkshayPM/ingredient_prune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_en.md b/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_en.md new file mode 100644 index 00000000000000..d05f8f91ac7be5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English itcall1_model T5Transformer from Venkata1 +author: John Snow Labs +name: itcall1_model +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`itcall1_model` is a English model originally trained by Venkata1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/itcall1_model_en_5.4.2_3.0_1724747647784.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/itcall1_model_en_5.4.2_3.0_1724747647784.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("itcall1_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("itcall1_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|itcall1_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.6 MB| + +## References + +https://huggingface.co/Venkata1/itcall1_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_pipeline_en.md new file mode 100644 index 00000000000000..3e8a9c520fdf50 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-itcall1_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English itcall1_model_pipeline pipeline T5Transformer from Venkata1 +author: John Snow Labs +name: itcall1_model_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`itcall1_model_pipeline` is a English model originally trained by Venkata1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/itcall1_model_pipeline_en_5.4.2_3.0_1724747679495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/itcall1_model_pipeline_en_5.4.2_3.0_1724747679495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("itcall1_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("itcall1_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|itcall1_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.6 MB| + +## References + +https://huggingface.co/Venkata1/itcall1_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_en.md b/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_en.md new file mode 100644 index 00000000000000..07d60c5dd5e269 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kinyarwanda T5Transformer from 90sUI +author: John Snow Labs +name: kinyarwanda +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kinyarwanda` is a English model originally trained by 90sUI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kinyarwanda_en_5.4.2_3.0_1724770691493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kinyarwanda_en_5.4.2_3.0_1724770691493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kinyarwanda","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kinyarwanda", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kinyarwanda| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/90sUI/rw \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_pipeline_en.md new file mode 100644 index 00000000000000..7ba765c1c7c614 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kinyarwanda_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kinyarwanda_pipeline pipeline T5Transformer from 90sUI +author: John Snow Labs +name: kinyarwanda_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kinyarwanda_pipeline` is a English model originally trained by 90sUI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kinyarwanda_pipeline_en_5.4.2_3.0_1724770850252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kinyarwanda_pipeline_en_5.4.2_3.0_1724770850252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kinyarwanda_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kinyarwanda_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kinyarwanda_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/90sUI/rw + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_en.md new file mode 100644 index 00000000000000..9f5fefc2ca1ba6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_opasl_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_opasl_v5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_opasl_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_opasl_v5_en_5.4.2_3.0_1724755766597.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_opasl_v5_en_5.4.2_3.0_1724755766597.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_opasl_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_opasl_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_opasl_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OPASL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_pipeline_en.md new file mode 100644 index 00000000000000..935dc66afe8e71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_opasl_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_opasl_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_opasl_v5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_opasl_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_opasl_v5_pipeline_en_5.4.2_3.0_1724755945986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_opasl_v5_pipeline_en_5.4.2_3.0_1724755945986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_opasl_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_opasl_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_opasl_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OPASL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_en.md new file mode 100644 index 00000000000000..4dc535ed29b329 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_psoal_v6 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psoal_v6 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psoal_v6` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v6_en_5.4.2_3.0_1724722149843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v6_en_5.4.2_3.0_1724722149843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal_v6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal_v6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psoal_v6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSOAL_v6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_pipeline_en.md new file mode 100644 index 00000000000000..8af26c51774922 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_psoal_v6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_psoal_v6_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psoal_v6_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psoal_v6_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v6_pipeline_en_5.4.2_3.0_1724722318627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_v6_pipeline_en_5.4.2_3.0_1724722318627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_psoal_v6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_psoal_v6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psoal_v6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSOAL_v6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_en.md new file mode 100644 index 00000000000000..4d77a92c403bd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_poasl_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_poasl_v4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_poasl_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_v4_en_5.4.2_3.0_1724772869407.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_v4_en_5.4.2_3.0_1724772869407.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_poasl_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_poasl_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_poasl_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POASL_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_pipeline_en.md new file mode 100644 index 00000000000000..5cefc763ae8b49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_poasl_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_poasl_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_poasl_v4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_poasl_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_v4_pipeline_en_5.4.2_3.0_1724773050562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_v4_pipeline_en_5.4.2_3.0_1724773050562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_poasl_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_poasl_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_poasl_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POASL_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_en.md new file mode 100644 index 00000000000000..01b8ba5be264c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_psoal_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_psoal_v4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_psoal_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v4_en_5.4.2_3.0_1724726482211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v4_en_5.4.2_3.0_1724726482211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_psoal_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_psoal_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_psoal_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PSOAL_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_pipeline_en.md new file mode 100644 index 00000000000000..8a76568d1b1be7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_psoal_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_psoal_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_psoal_v4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_psoal_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v4_pipeline_en_5.4.2_3.0_1724726649082.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v4_pipeline_en_5.4.2_3.0_1724726649082.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_psoal_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_psoal_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_psoal_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PSOAL_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en.md new file mode 100644 index 00000000000000..732c54dd80289c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en_5.4.2_3.0_1724759445176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en_5.4.2_3.0_1724759445176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_7_RS_SE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en.md new file mode 100644 index 00000000000000..c68c8737c9a8f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en_5.4.2_3.0_1724759613665.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en_5.4.2_3.0_1724759613665.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_7_RS_SE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_en.md new file mode 100644 index 00000000000000..88ca0a4e8a072d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_soapl_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_soapl_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_soapl_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v2_en_5.4.2_3.0_1724740016556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v2_en_5.4.2_3.0_1724740016556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_soapl_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_soapl_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_soapl_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SOAPL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_pipeline_en.md new file mode 100644 index 00000000000000..d27e471cbec55b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_soapl_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_soapl_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_soapl_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_soapl_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v2_pipeline_en_5.4.2_3.0_1724740183057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_soapl_v2_pipeline_en_5.4.2_3.0_1724740183057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_soapl_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_soapl_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_soapl_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SOAPL_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_en.md new file mode 100644 index 00000000000000..2680044146f05d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_spaol_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_spaol_v3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_spaol_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_v3_en_5.4.2_3.0_1724758175157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_v3_en_5.4.2_3.0_1724758175157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_spaol_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_spaol_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_spaol_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SPAOL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_pipeline_en.md new file mode 100644 index 00000000000000..8fdcbeadef0566 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kltn_coqe_vit5_total_spaol_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_spaol_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_spaol_v3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_spaol_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_v3_pipeline_en_5.4.2_3.0_1724758345956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_v3_pipeline_en_5.4.2_3.0_1724758345956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_spaol_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_spaol_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_spaol_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SPAOL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_en.md b/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_en.md new file mode 100644 index 00000000000000..e7ed00b82cd546 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kt_qa_generate T5Transformer from kelvinleong +author: John Snow Labs +name: kt_qa_generate +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kt_qa_generate` is a English model originally trained by kelvinleong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kt_qa_generate_en_5.4.2_3.0_1724764707735.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kt_qa_generate_en_5.4.2_3.0_1724764707735.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kt_qa_generate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kt_qa_generate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kt_qa_generate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|844.2 MB| + +## References + +https://huggingface.co/kelvinleong/KT_QA_generate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_pipeline_en.md new file mode 100644 index 00000000000000..7aa8d128858aca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-kt_qa_generate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kt_qa_generate_pipeline pipeline T5Transformer from kelvinleong +author: John Snow Labs +name: kt_qa_generate_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kt_qa_generate_pipeline` is a English model originally trained by kelvinleong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kt_qa_generate_pipeline_en_5.4.2_3.0_1724764795729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kt_qa_generate_pipeline_en_5.4.2_3.0_1724764795729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kt_qa_generate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kt_qa_generate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kt_qa_generate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|844.2 MB| + +## References + +https://huggingface.co/kelvinleong/KT_QA_generate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_en.md new file mode 100644 index 00000000000000..21e5648150206b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_spanish +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_spanish_en_5.4.2_3.0_1724729785901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_spanish_en_5.4.2_3.0_1724729785901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_pipeline_en.md new file mode 100644 index 00000000000000..9574d74980113f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_cls_finetuned_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_spanish_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_spanish_pipeline_en_5.4.2_3.0_1724729846170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_spanish_pipeline_en_5.4.2_3.0_1724729846170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_finetuned_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_finetuned_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_en.md new file mode 100644 index 00000000000000..9df284102a2b14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_italian_czech T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_italian_czech +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_italian_czech` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_czech_en_5.4.2_3.0_1724747043993.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_czech_en_5.4.2_3.0_1724747043993.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_italian_czech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_italian_czech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_italian_czech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_it_cs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_pipeline_en.md new file mode 100644 index 00000000000000..12cfceadef36fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_italian_czech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_italian_czech_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_italian_czech_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_italian_czech_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_czech_pipeline_en_5.4.2_3.0_1724747102936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_italian_czech_pipeline_en_5.4.2_3.0_1724747102936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_italian_czech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_italian_czech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_italian_czech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_it_cs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_en.md new file mode 100644 index 00000000000000..5f5d863da37664 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_english +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_english_en_5.4.2_3.0_1724749413063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_english_en_5.4.2_3.0_1724749413063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_pipeline_en.md new file mode 100644 index 00000000000000..08fa9f5eb74664 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_multitask_swedish_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_english_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_english_pipeline_en_5.4.2_3.0_1724749473858.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_english_pipeline_en_5.4.2_3.0_1724749473858.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_swedish_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_swedish_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_en.md new file mode 100644 index 00000000000000..51582d809d3c51 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_german +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_german_en_5.4.2_3.0_1724765110331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_german_en_5.4.2_3.0_1724765110331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.7 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_pipeline_en.md new file mode 100644 index 00000000000000..a5c42982db79e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_summ_multitask_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_german_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_german_pipeline_en_5.4.2_3.0_1724765169511.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_german_pipeline_en_5.4.2_3.0_1724765169511.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_multitask_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_multitask_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.7 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_en.md new file mode 100644 index 00000000000000..3d6016966c7248 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_german_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_german_small_finetuned +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_german_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_german_small_finetuned_en_5.4.2_3.0_1724760278312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_german_small_finetuned_en_5.4.2_3.0_1724760278312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_german_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_german_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_german_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_de_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..c644ee94710455 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_german_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_german_small_finetuned_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_german_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_german_small_finetuned_pipeline_en_5.4.2_3.0_1724760338339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_german_small_finetuned_pipeline_en_5.4.2_3.0_1724760338339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_czech_german_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_czech_german_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_german_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_de_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_en.md b/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_en.md new file mode 100644 index 00000000000000..25306671dbf200 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_tglobal_large_multimedia T5Transformer from QuangHuy54 +author: John Snow Labs +name: long_t5_tglobal_large_multimedia +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_tglobal_large_multimedia` is a English model originally trained by QuangHuy54. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_large_multimedia_en_5.4.2_3.0_1724767852546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_large_multimedia_en_5.4.2_3.0_1724767852546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_tglobal_large_multimedia","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_tglobal_large_multimedia", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_tglobal_large_multimedia| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QuangHuy54/long-t5-tglobal-large-multimedia \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_pipeline_en.md new file mode 100644 index 00000000000000..0daf55768ff96b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-long_t5_tglobal_large_multimedia_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_tglobal_large_multimedia_pipeline pipeline T5Transformer from QuangHuy54 +author: John Snow Labs +name: long_t5_tglobal_large_multimedia_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_tglobal_large_multimedia_pipeline` is a English model originally trained by QuangHuy54. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_large_multimedia_pipeline_en_5.4.2_3.0_1724767899908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_tglobal_large_multimedia_pipeline_en_5.4.2_3.0_1724767899908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_tglobal_large_multimedia_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_tglobal_large_multimedia_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_tglobal_large_multimedia_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QuangHuy54/long-t5-tglobal-large-multimedia + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_en.md b/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_en.md new file mode 100644 index 00000000000000..201c91f5de45ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English longt5_tglobal_base_scipaper T5Transformer from achang +author: John Snow Labs +name: longt5_tglobal_base_scipaper +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`longt5_tglobal_base_scipaper` is a English model originally trained by achang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/longt5_tglobal_base_scipaper_en_5.4.2_3.0_1724772363794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/longt5_tglobal_base_scipaper_en_5.4.2_3.0_1724772363794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("longt5_tglobal_base_scipaper","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("longt5_tglobal_base_scipaper", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|longt5_tglobal_base_scipaper| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/achang/longt5-tglobal-base-scipaper \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_pipeline_en.md new file mode 100644 index 00000000000000..87070c864f2b34 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-longt5_tglobal_base_scipaper_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English longt5_tglobal_base_scipaper_pipeline pipeline T5Transformer from achang +author: John Snow Labs +name: longt5_tglobal_base_scipaper_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`longt5_tglobal_base_scipaper_pipeline` is a English model originally trained by achang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/longt5_tglobal_base_scipaper_pipeline_en_5.4.2_3.0_1724772412687.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/longt5_tglobal_base_scipaper_pipeline_en_5.4.2_3.0_1724772412687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("longt5_tglobal_base_scipaper_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("longt5_tglobal_base_scipaper_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|longt5_tglobal_base_scipaper_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/achang/longt5-tglobal-base-scipaper + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-low9_en.md b/docs/_posts/ahmedlone127/2024-08-27-low9_en.md new file mode 100644 index 00000000000000..9e3a20c325db07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-low9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low9 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low9 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low9` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low9_en_5.4.2_3.0_1724744672939.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low9_en_5.4.2_3.0_1724744672939.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.8 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-low9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-low9_pipeline_en.md new file mode 100644 index 00000000000000..812843e5f80c46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-low9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low9_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low9_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low9_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low9_pipeline_en_5.4.2_3.0_1724744729131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low9_pipeline_en_5.4.2_3.0_1724744729131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.8 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-lt5_large_en.md b/docs/_posts/ahmedlone127/2024-08-27-lt5_large_en.md new file mode 100644 index 00000000000000..aff0ddfd973067 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-lt5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lt5_large T5Transformer from santoshtyss +author: John Snow Labs +name: lt5_large +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lt5_large` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lt5_large_en_5.4.2_3.0_1724760888093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lt5_large_en_5.4.2_3.0_1724760888093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lt5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lt5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lt5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/santoshtyss/lt5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-lt5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-lt5_large_pipeline_en.md new file mode 100644 index 00000000000000..c566329d06f591 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-lt5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lt5_large_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: lt5_large_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lt5_large_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lt5_large_pipeline_en_5.4.2_3.0_1724761032765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lt5_large_pipeline_en_5.4.2_3.0_1724761032765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lt5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lt5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lt5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/santoshtyss/lt5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_en.md b/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_en.md new file mode 100644 index 00000000000000..580386dcdd68b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English m5_small_hindi_english T5Transformer from Osquery +author: John Snow Labs +name: m5_small_hindi_english +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`m5_small_hindi_english` is a English model originally trained by Osquery. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/m5_small_hindi_english_en_5.4.2_3.0_1724761172766.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/m5_small_hindi_english_en_5.4.2_3.0_1724761172766.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("m5_small_hindi_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("m5_small_hindi_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|m5_small_hindi_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.9 MB| + +## References + +https://huggingface.co/Osquery/m5-small-hi-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_pipeline_en.md new file mode 100644 index 00000000000000..7e1a8f848f905a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-m5_small_hindi_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English m5_small_hindi_english_pipeline pipeline T5Transformer from Osquery +author: John Snow Labs +name: m5_small_hindi_english_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`m5_small_hindi_english_pipeline` is a English model originally trained by Osquery. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/m5_small_hindi_english_pipeline_en_5.4.2_3.0_1724761193688.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/m5_small_hindi_english_pipeline_en_5.4.2_3.0_1724761193688.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("m5_small_hindi_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("m5_small_hindi_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|m5_small_hindi_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.9 MB| + +## References + +https://huggingface.co/Osquery/m5-small-hi-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_en.md b/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_en.md new file mode 100644 index 00000000000000..0a3ab1ecb5a483 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English malayalam_sum_v1 T5Transformer from mHossain +author: John Snow Labs +name: malayalam_sum_v1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`malayalam_sum_v1` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/malayalam_sum_v1_en_5.4.2_3.0_1724756935596.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/malayalam_sum_v1_en_5.4.2_3.0_1724756935596.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("malayalam_sum_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("malayalam_sum_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|malayalam_sum_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.2 MB| + +## References + +https://huggingface.co/mHossain/ml_sum_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_pipeline_en.md new file mode 100644 index 00000000000000..982987a146089f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-malayalam_sum_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English malayalam_sum_v1_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: malayalam_sum_v1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`malayalam_sum_v1_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/malayalam_sum_v1_pipeline_en_5.4.2_3.0_1724756995969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/malayalam_sum_v1_pipeline_en_5.4.2_3.0_1724756995969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("malayalam_sum_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("malayalam_sum_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|malayalam_sum_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.2 MB| + +## References + +https://huggingface.co/mHossain/ml_sum_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mrpc_en.md b/docs/_posts/ahmedlone127/2024-08-27-mrpc_en.md new file mode 100644 index 00000000000000..4e86b5a07e7af8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mrpc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mrpc T5Transformer from ShengdingHu +author: John Snow Labs +name: mrpc +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_en_5.4.2_3.0_1724760281448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_en_5.4.2_3.0_1724760281448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mrpc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mrpc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/mrpc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mrpc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mrpc_pipeline_en.md new file mode 100644 index 00000000000000..da5a898b2b1ea5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mrpc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mrpc_pipeline pipeline T5Transformer from ShengdingHu +author: John Snow Labs +name: mrpc_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_pipeline` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_pipeline_en_5.4.2_3.0_1724760327996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_pipeline_en_5.4.2_3.0_1724760327996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mrpc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mrpc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/mrpc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_600m_flores200_scaffold_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_600m_flores200_scaffold_en.md new file mode 100644 index 00000000000000..ddbff519bc1fb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_600m_flores200_scaffold_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_600m_flores200_scaffold T5Transformer from hlillemark +author: John Snow Labs +name: mt5_600m_flores200_scaffold +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_600m_flores200_scaffold` is a English model originally trained by hlillemark. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_600m_flores200_scaffold_en_5.4.2_3.0_1724721236168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_600m_flores200_scaffold_en_5.4.2_3.0_1724721236168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_600m_flores200_scaffold","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_600m_flores200_scaffold", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_600m_flores200_scaffold| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/hlillemark/mt5-600M-flores200-scaffold \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_en.md new file mode 100644 index 00000000000000..9231abbad73a1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_60000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_60000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_60000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_60000_en_5.4.2_3.0_1724766831037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_60000_en_5.4.2_3.0_1724766831037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_pipeline_en.md new file mode 100644 index 00000000000000..d3ce0368a7ac8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_60000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_60000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_60000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_60000_pipeline_en_5.4.2_3.0_1724767033302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_60000_pipeline_en_5.4.2_3.0_1724767033302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_en.md new file mode 100644 index 00000000000000..771d50825a8ea5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_amazon_title_generation_japanese T5Transformer from rkamimae +author: John Snow Labs +name: mt5_base_amazon_title_generation_japanese +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_amazon_title_generation_japanese` is a English model originally trained by rkamimae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_amazon_title_generation_japanese_en_5.4.2_3.0_1724746639430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_amazon_title_generation_japanese_en_5.4.2_3.0_1724746639430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_amazon_title_generation_japanese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_amazon_title_generation_japanese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_amazon_title_generation_japanese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/rkamimae/mt5-base-amazon-title-generation-japanese \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_pipeline_en.md new file mode 100644 index 00000000000000..937bd3826f2176 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_amazon_title_generation_japanese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_amazon_title_generation_japanese_pipeline pipeline T5Transformer from rkamimae +author: John Snow Labs +name: mt5_base_amazon_title_generation_japanese_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_amazon_title_generation_japanese_pipeline` is a English model originally trained by rkamimae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_amazon_title_generation_japanese_pipeline_en_5.4.2_3.0_1724746802026.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_amazon_title_generation_japanese_pipeline_en_5.4.2_3.0_1724746802026.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_amazon_title_generation_japanese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_amazon_title_generation_japanese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_amazon_title_generation_japanese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/rkamimae/mt5-base-amazon-title-generation-japanese + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_en.md new file mode 100644 index 00000000000000..b9d773f7f8779f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_dimensions_polisci T5Transformer from ey211 +author: John Snow Labs +name: mt5_base_finetuned_dimensions_polisci +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_dimensions_polisci` is a English model originally trained by ey211. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_dimensions_polisci_en_5.4.2_3.0_1724732987716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_dimensions_polisci_en_5.4.2_3.0_1724732987716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_dimensions_polisci","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_dimensions_polisci", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_dimensions_polisci| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ey211/mt5-base-finetuned-dimensions-polisci \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_pipeline_en.md new file mode 100644 index 00000000000000..8e73460158f304 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_dimensions_polisci_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_dimensions_polisci_pipeline pipeline T5Transformer from ey211 +author: John Snow Labs +name: mt5_base_finetuned_dimensions_polisci_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_dimensions_polisci_pipeline` is a English model originally trained by ey211. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_dimensions_polisci_pipeline_en_5.4.2_3.0_1724733034140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_dimensions_polisci_pipeline_en_5.4.2_3.0_1724733034140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_dimensions_polisci_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_dimensions_polisci_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_dimensions_polisci_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ey211/mt5-base-finetuned-dimensions-polisci + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en.md new file mode 100644 index 00000000000000..8c7e0d22a3f2ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en_5.4.2_3.0_1724751075538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en_5.4.2_3.0_1724751075538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-base-finetuned-kk-to-en-filthy-American \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_notes_summaries_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_notes_summaries_en.md new file mode 100644 index 00000000000000..54ce29fda2cf1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_notes_summaries_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_notes_summaries T5Transformer from mrm8488 +author: John Snow Labs +name: mt5_base_finetuned_notes_summaries +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_notes_summaries` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_notes_summaries_en_5.4.2_3.0_1724774851607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_notes_summaries_en_5.4.2_3.0_1724774851607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_notes_summaries","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_notes_summaries", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_notes_summaries| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/mrm8488/mt5-base-finetuned-notes-summaries \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_en.md new file mode 100644 index 00000000000000..2741e8fddd2d12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_old_slovene T5Transformer from martinjurkovic +author: John Snow Labs +name: mt5_base_finetuned_old_slovene +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_old_slovene` is a English model originally trained by martinjurkovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_old_slovene_en_5.4.2_3.0_1724746282214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_old_slovene_en_5.4.2_3.0_1724746282214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_old_slovene","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_old_slovene", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_old_slovene| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/martinjurkovic/mt5-base-finetuned-old-slovene \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_pipeline_en.md new file mode 100644 index 00000000000000..44c814d4cbc4ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_old_slovene_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_old_slovene_pipeline pipeline T5Transformer from martinjurkovic +author: John Snow Labs +name: mt5_base_finetuned_old_slovene_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_old_slovene_pipeline` is a English model originally trained by martinjurkovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_old_slovene_pipeline_en_5.4.2_3.0_1724746453236.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_old_slovene_pipeline_en_5.4.2_3.0_1724746453236.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_old_slovene_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_old_slovene_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_old_slovene_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/martinjurkovic/mt5-base-finetuned-old-slovene + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_onet_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_onet_en.md new file mode 100644 index 00000000000000..6ae5b50093cb0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_onet_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_onet T5Transformer from Adamas23 +author: John Snow Labs +name: mt5_base_finetuned_onet +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_onet` is a English model originally trained by Adamas23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_onet_en_5.4.2_3.0_1724766641368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_onet_en_5.4.2_3.0_1724766641368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_onet","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_onet", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_onet| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Adamas23/mt5-base-finetuned-onet \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159_en.md new file mode 100644 index 00000000000000..bc302fd2cb0a99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159 T5Transformer from emilstabil +author: John Snow Labs +name: mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159` is a English model originally trained by emilstabil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159_en_5.4.2_3.0_1724748276793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159_en_5.4.2_3.0_1724748276793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_test_30483_prefix_summarize_finetuned_test_21911_prefix_summarize_v12159| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/emilstabil/mt5-base-finetuned-test_30483_prefix_summarize-finetuned-test_21911_prefix_summarize_V12159 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_en.md new file mode 100644 index 00000000000000..3a2f030a630947 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_horikawamegu T5Transformer from HorikawaMegu +author: John Snow Labs +name: mt5_base_horikawamegu +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_horikawamegu` is a English model originally trained by HorikawaMegu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_horikawamegu_en_5.4.2_3.0_1724750352255.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_horikawamegu_en_5.4.2_3.0_1724750352255.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_horikawamegu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_horikawamegu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_horikawamegu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/HorikawaMegu/mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_pipeline_en.md new file mode 100644 index 00000000000000..6044f1af97f058 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_horikawamegu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_horikawamegu_pipeline pipeline T5Transformer from HorikawaMegu +author: John Snow Labs +name: mt5_base_horikawamegu_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_horikawamegu_pipeline` is a English model originally trained by HorikawaMegu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_horikawamegu_pipeline_en_5.4.2_3.0_1724750586259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_horikawamegu_pipeline_en_5.4.2_3.0_1724750586259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_horikawamegu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_horikawamegu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_horikawamegu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/HorikawaMegu/mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_en.md new file mode 100644 index 00000000000000..e6e15e05654cdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_lit_simplif T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_base_lit_simplif +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_lit_simplif` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_lit_simplif_en_5.4.2_3.0_1724761681410.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_lit_simplif_en_5.4.2_3.0_1724761681410.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_lit_simplif","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_lit_simplif", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_lit_simplif| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/eglkan1/mt5-base-lit-simplif \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_pipeline_en.md new file mode 100644 index 00000000000000..1849a58a8565da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_lit_simplif_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_lit_simplif_pipeline pipeline T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_base_lit_simplif_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_lit_simplif_pipeline` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_lit_simplif_pipeline_en_5.4.2_3.0_1724761986691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_lit_simplif_pipeline_en_5.4.2_3.0_1724761986691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_lit_simplif_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_lit_simplif_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_lit_simplif_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/eglkan1/mt5-base-lit-simplif + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_nc16_400_deen_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_nc16_400_deen_en.md new file mode 100644 index 00000000000000..5097734ce2de77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_nc16_400_deen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_400_deen T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_400_deen +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_400_deen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_deen_en_5.4.2_3.0_1724746835052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_deen_en_5.4.2_3.0_1724746835052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_400_deen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_400_deen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_400_deen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-400-deen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_en.md new file mode 100644 index 00000000000000..c95bb474098669 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_spanish_dg T5Transformer from davidFD19 +author: John Snow Labs +name: mt5_base_spanish_dg +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_spanish_dg` is a English model originally trained by davidFD19. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_dg_en_5.4.2_3.0_1724737936003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_dg_en_5.4.2_3.0_1724737936003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_spanish_dg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_spanish_dg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_spanish_dg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/davidFD19/mt5-base-es-dg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_pipeline_en.md new file mode 100644 index 00000000000000..6fade305272e55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_spanish_dg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_spanish_dg_pipeline pipeline T5Transformer from davidFD19 +author: John Snow Labs +name: mt5_base_spanish_dg_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_spanish_dg_pipeline` is a English model originally trained by davidFD19. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_dg_pipeline_en_5.4.2_3.0_1724738079811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_dg_pipeline_en_5.4.2_3.0_1724738079811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_spanish_dg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_spanish_dg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_spanish_dg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/davidFD19/mt5-base-es-dg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_en.md new file mode 100644 index 00000000000000..eb332a626438ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_french_60000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_60000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_60000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_60000_en_5.4.2_3.0_1724739496313.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_60000_en_5.4.2_3.0_1724739496313.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_french_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_french_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|645.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_pipeline_en.md new file mode 100644 index 00000000000000..737c32bf1ca6c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_french_60000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_60000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_60000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_60000_pipeline_en_5.4.2_3.0_1724739713408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_60000_pipeline_en_5.4.2_3.0_1724739713408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_french_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_french_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|645.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_en.md new file mode 100644 index 00000000000000..d21dd679eb8ddf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_french T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_en_5.4.2_3.0_1724754442677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_en_5.4.2_3.0_1724754442677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|958.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_pipeline_en.md new file mode 100644 index 00000000000000..7749e726e40420 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_french_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_pipeline_en_5.4.2_3.0_1724754752119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_pipeline_en_5.4.2_3.0_1724754752119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|958.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_en.md new file mode 100644 index 00000000000000..a3b096d601ac68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_75000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_75000_en_5.4.2_3.0_1724750516359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_75000_en_5.4.2_3.0_1724750516359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_pipeline_en.md new file mode 100644 index 00000000000000..713ad9899f6beb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_japanese_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_75000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_75000_pipeline_en_5.4.2_3.0_1724750754730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_75000_pipeline_en_5.4.2_3.0_1724750754730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_japanese_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_japanese_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|711.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_en.md new file mode 100644 index 00000000000000..0b4634e29b7a77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_korean T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_korean +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_korean` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_en_5.4.2_3.0_1724727295777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_en_5.4.2_3.0_1724727295777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_korean","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_korean", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_korean| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|704.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ko \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_pipeline_en.md new file mode 100644 index 00000000000000..65972fe1fae9c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_trimmed_korean_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_korean_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_korean_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_korean_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_pipeline_en_5.4.2_3.0_1724727527051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_korean_pipeline_en_5.4.2_3.0_1724727527051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_korean_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_korean_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_korean_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|704.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ko + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..06ee1110989aac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_zhquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_zhquad_ae_trimmed_50000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_zhquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_trimmed_50000_en_5.4.2_3.0_1724731141799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_trimmed_50000_en_5.4.2_3.0_1724731141799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_zhquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_zhquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_zhquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-zhquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..3bc446561eca0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_base_zhquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_zhquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_zhquad_ae_trimmed_50000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_zhquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724731207211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_zhquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724731207211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_zhquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_zhquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_zhquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-zhquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_en.md new file mode 100644 index 00000000000000..74e94ec886b403 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_empty T5Transformer from Roy029 +author: John Snow Labs +name: mt5_empty +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_empty` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_empty_en_5.4.2_3.0_1724730358215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_empty_en_5.4.2_3.0_1724730358215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_empty","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_empty", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_empty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_empty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_pipeline_en.md new file mode 100644 index 00000000000000..9ccc10797bee7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_empty_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_empty_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: mt5_empty_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_empty_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_empty_pipeline_en_5.4.2_3.0_1724730518224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_empty_pipeline_en_5.4.2_3.0_1724730518224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_empty_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_empty_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_empty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_empty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_en.md new file mode 100644 index 00000000000000..c10001b61ea572 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_tonga_tonga_islands_hindi T5Transformer from jash33 +author: John Snow Labs +name: mt5_english_tonga_tonga_islands_hindi +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_tonga_tonga_islands_hindi` is a English model originally trained by jash33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_tonga_tonga_islands_hindi_en_5.4.2_3.0_1724724434096.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_tonga_tonga_islands_hindi_en_5.4.2_3.0_1724724434096.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_tonga_tonga_islands_hindi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_tonga_tonga_islands_hindi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_tonga_tonga_islands_hindi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/jash33/mt5-en-to-hi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_pipeline_en.md new file mode 100644 index 00000000000000..2f8a845a83a4e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_english_tonga_tonga_islands_hindi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_english_tonga_tonga_islands_hindi_pipeline pipeline T5Transformer from jash33 +author: John Snow Labs +name: mt5_english_tonga_tonga_islands_hindi_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_tonga_tonga_islands_hindi_pipeline` is a English model originally trained by jash33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_tonga_tonga_islands_hindi_pipeline_en_5.4.2_3.0_1724724522121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_tonga_tonga_islands_hindi_pipeline_en_5.4.2_3.0_1724724522121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_english_tonga_tonga_islands_hindi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_english_tonga_tonga_islands_hindi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_tonga_tonga_islands_hindi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/jash33/mt5-en-to-hi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_en.md new file mode 100644 index 00000000000000..1b0860445e5251 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_german_rr_1000_v2 T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_german_rr_1000_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_german_rr_1000_v2` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_v2_en_5.4.2_3.0_1724727824612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_v2_en_5.4.2_3.0_1724727824612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_german_rr_1000_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_german_rr_1000_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_german_rr_1000_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-de-rr-1000-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_pipeline_en.md new file mode 100644 index 00000000000000..8f818998541883 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_german_rr_1000_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_german_rr_1000_v2_pipeline pipeline T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_german_rr_1000_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_german_rr_1000_v2_pipeline` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_v2_pipeline_en_5.4.2_3.0_1724727986940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_v2_pipeline_en_5.4.2_3.0_1724727986940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_german_rr_1000_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_german_rr_1000_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_german_rr_1000_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-de-rr-1000-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_multitask_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_multitask_finetuned_en.md new file mode 100644 index 00000000000000..284ba9319119d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_multitask_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_multitask_finetuned T5Transformer from parinzee +author: John Snow Labs +name: mt5_multitask_finetuned +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_multitask_finetuned` is a English model originally trained by parinzee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_multitask_finetuned_en_5.4.2_3.0_1724771370905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_multitask_finetuned_en_5.4.2_3.0_1724771370905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_multitask_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_multitask_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_multitask_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/parinzee/mt5-multitask-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_en.md new file mode 100644 index 00000000000000..9d7d8bcf94e2c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_news_sum T5Transformer from drive087 +author: John Snow Labs +name: mt5_news_sum +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_news_sum` is a English model originally trained by drive087. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_news_sum_en_5.4.2_3.0_1724722663386.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_news_sum_en_5.4.2_3.0_1724722663386.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_news_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_news_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_news_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/drive087/mt5_news_sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_pipeline_en.md new file mode 100644 index 00000000000000..fd3dfa09c0406c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_news_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_news_sum_pipeline pipeline T5Transformer from drive087 +author: John Snow Labs +name: mt5_news_sum_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_news_sum_pipeline` is a English model originally trained by drive087. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_news_sum_pipeline_en_5.4.2_3.0_1724722909335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_news_sum_pipeline_en_5.4.2_3.0_1724722909335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_news_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_news_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_news_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/drive087/mt5_news_sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_en.md new file mode 100644 index 00000000000000..6b97d579d1f480 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_catalan_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_catalan_10k +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_catalan_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_catalan_10k_en_5.4.2_3.0_1724759120957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_catalan_10k_en_5.4.2_3.0_1724759120957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_catalan_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_catalan_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_catalan_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ca-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_pipeline_en.md new file mode 100644 index 00000000000000..cf948d66bcb88d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_catalan_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_catalan_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_catalan_10k_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_catalan_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_catalan_10k_pipeline_en_5.4.2_3.0_1724759273151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_catalan_10k_pipeline_en_5.4.2_3.0_1724759273151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_catalan_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_catalan_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_catalan_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ca-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_en.md new file mode 100644 index 00000000000000..e129c5b3a9b194 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esperanto_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_esperanto_10k +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esperanto_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esperanto_10k_en_5.4.2_3.0_1724719628092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esperanto_10k_en_5.4.2_3.0_1724719628092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esperanto_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esperanto_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esperanto_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-eo-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_pipeline_en.md new file mode 100644 index 00000000000000..53bcc6ae081da1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esperanto_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esperanto_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_esperanto_10k_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esperanto_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esperanto_10k_pipeline_en_5.4.2_3.0_1724719770758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esperanto_10k_pipeline_en_5.4.2_3.0_1724719770758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esperanto_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esperanto_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esperanto_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-eo-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_en.md new file mode 100644 index 00000000000000..2853abb256993a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_10000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_10000_en_5.4.2_3.0_1724738641072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_10000_en_5.4.2_3.0_1724738641072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|224.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_pipeline_en.md new file mode 100644 index 00000000000000..bcbaa4ea701309 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_esquad_qa_trimmed_spanish_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_10000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_10000_pipeline_en_5.4.2_3.0_1724738651857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_10000_pipeline_en_5.4.2_3.0_1724738651857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|224.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_en.md new file mode 100644 index 00000000000000..3f2962384f6f72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_8 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_8 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_8` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_8_en_5.4.2_3.0_1724759828204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_8_en_5.4.2_3.0_1724759828204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_13feb_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_pipeline_en.md new file mode 100644 index 00000000000000..2b59eb12ae527f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_13feb_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_13feb_8_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_13feb_8_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_13feb_8_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_8_pipeline_en_5.4.2_3.0_1724760016674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_13feb_8_pipeline_en_5.4.2_3.0_1724760016674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_13feb_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_13feb_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_13feb_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-13feb-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_en.md new file mode 100644 index 00000000000000..1f94948afd2bdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_1_0_2 T5Transformer from jamesesguerra +author: John Snow Labs +name: mt5_small_finetuned_1_0_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1_0_2` is a English model originally trained by jamesesguerra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_0_2_en_5.4.2_3.0_1724763225187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_0_2_en_5.4.2_3.0_1724763225187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_1_0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_1_0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1_0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jamesesguerra/mt5-small-finetuned-1.0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_pipeline_en.md new file mode 100644 index 00000000000000..e3427b297b4c70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_1_0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_1_0_2_pipeline pipeline T5Transformer from jamesesguerra +author: John Snow Labs +name: mt5_small_finetuned_1_0_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1_0_2_pipeline` is a English model originally trained by jamesesguerra. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_0_2_pipeline_en_5.4.2_3.0_1724763316256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1_0_2_pipeline_en_5.4.2_3.0_1724763316256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_1_0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_1_0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1_0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jamesesguerra/mt5-small-finetuned-1.0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_en.md new file mode 100644 index 00000000000000..45089c15f995c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian T5Transformer from mriggs +author: John Snow Labs +name: mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724740729834.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724740729834.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mriggs/mt5-small-finetuned-2epochs-opus_books-en-to-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md new file mode 100644 index 00000000000000..9bd8cb7abd2f4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline pipeline T5Transformer from mriggs +author: John Snow Labs +name: mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724740816314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724740816314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_2epochs_opus_books_english_tonga_tonga_islands_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mriggs/mt5-small-finetuned-2epochs-opus_books-en-to-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..6aa1ecfb446f81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_5k_thai_tonga_tonga_islands_english T5Transformer from kenjis2542 +author: John Snow Labs +name: mt5_small_finetuned_5k_thai_tonga_tonga_islands_english +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_5k_thai_tonga_tonga_islands_english` is a English model originally trained by kenjis2542. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_en_5.4.2_3.0_1724736135671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_en_5.4.2_3.0_1724736135671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_5k_thai_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_5k_thai_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_5k_thai_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/kenjis2542/mt5-small-finetuned-5k-th-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..8924c3d2663d52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline pipeline T5Transformer from kenjis2542 +author: John Snow Labs +name: mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline` is a English model originally trained by kenjis2542. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724736410712.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724736410712.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_5k_thai_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/kenjis2542/mt5-small-finetuned-5k-th-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_en.md new file mode 100644 index 00000000000000..cf52834f929004 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_dlakeev T5Transformer from dlakeev +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_dlakeev +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_dlakeev` is a English model originally trained by dlakeev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_dlakeev_en_5.4.2_3.0_1724765673651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_dlakeev_en_5.4.2_3.0_1724765673651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_dlakeev","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_dlakeev", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_dlakeev| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dlakeev/mt5-small-finetuned-amazon-en-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en.md new file mode 100644 index 00000000000000..891cd026bd1e1d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_dlakeev_pipeline pipeline T5Transformer from dlakeev +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_dlakeev_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_dlakeev_pipeline` is a English model originally trained by dlakeev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en_5.4.2_3.0_1724765797418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en_5.4.2_3.0_1724765797418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_german_dlakeev_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_german_dlakeev_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_dlakeev_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dlakeev/mt5-small-finetuned-amazon-en-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_en.md new file mode 100644 index 00000000000000..b204d4a30999dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_anasmd4u T5Transformer from anasmd4u +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_anasmd4u +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_anasmd4u` is a English model originally trained by anasmd4u. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anasmd4u_en_5.4.2_3.0_1724748817059.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anasmd4u_en_5.4.2_3.0_1724748817059.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_anasmd4u","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_anasmd4u", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_anasmd4u| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/anasmd4u/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline_en.md new file mode 100644 index 00000000000000..33dbd6ff66ce05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline pipeline T5Transformer from anasmd4u +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline` is a English model originally trained by anasmd4u. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline_en_5.4.2_3.0_1724748912415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline_en_5.4.2_3.0_1724748912415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_anasmd4u_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/anasmd4u/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_en.md new file mode 100644 index 00000000000000..9543dba0ce79f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jkv53 T5Transformer from jkv53 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jkv53 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jkv53` is a English model originally trained by jkv53. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jkv53_en_5.4.2_3.0_1724741624109.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jkv53_en_5.4.2_3.0_1724741624109.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jkv53","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jkv53", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jkv53| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jkv53/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline_en.md new file mode 100644 index 00000000000000..bf0c01faa02cdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline pipeline T5Transformer from jkv53 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline` is a English model originally trained by jkv53. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline_en_5.4.2_3.0_1724741738271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline_en_5.4.2_3.0_1724741738271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jkv53_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jkv53/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_en.md new file mode 100644 index 00000000000000..f0d63db791638f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_mufinapps T5Transformer from MufinApps +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_mufinapps +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_mufinapps` is a English model originally trained by MufinApps. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_mufinapps_en_5.4.2_3.0_1724736615684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_mufinapps_en_5.4.2_3.0_1724736615684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_mufinapps","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_mufinapps", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_mufinapps| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/MufinApps/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline_en.md new file mode 100644 index 00000000000000..7cc44a7d0d944f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline pipeline T5Transformer from MufinApps +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline` is a English model originally trained by MufinApps. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline_en_5.4.2_3.0_1724736737016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline_en_5.4.2_3.0_1724736737016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_mufinapps_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/MufinApps/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_en.md new file mode 100644 index 00000000000000..872a69b89b41af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_shushantllm T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_shushantllm +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_shushantllm` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_shushantllm_en_5.4.2_3.0_1724765324538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_shushantllm_en_5.4.2_3.0_1724765324538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_shushantllm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_shushantllm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_shushantllm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en.md new file mode 100644 index 00000000000000..1efa4380fb0d9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline pipeline T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en_5.4.2_3.0_1724765438493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en_5.4.2_3.0_1724765438493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_en.md new file mode 100644 index 00000000000000..2b28e83061e938 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tzurvaich T5Transformer from TzurVaich +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tzurvaich +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tzurvaich` is a English model originally trained by TzurVaich. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tzurvaich_en_5.4.2_3.0_1724772145778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tzurvaich_en_5.4.2_3.0_1724772145778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tzurvaich","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tzurvaich", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tzurvaich| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/TzurVaich/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en.md new file mode 100644 index 00000000000000..fc42288ebd86d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline pipeline T5Transformer from TzurVaich +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline` is a English model originally trained by TzurVaich. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en_5.4.2_3.0_1724772240906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en_5.4.2_3.0_1724772240906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/TzurVaich/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_en.md new file mode 100644 index 00000000000000..578cc77b83022d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_undimoel T5Transformer from undimoel +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_undimoel +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_undimoel` is a English model originally trained by undimoel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_undimoel_en_5.4.2_3.0_1724739277774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_undimoel_en_5.4.2_3.0_1724739277774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_undimoel","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_undimoel", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_undimoel| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/undimoel/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline_en.md new file mode 100644 index 00000000000000..d6b8b743ca4654 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline pipeline T5Transformer from undimoel +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline` is a English model originally trained by undimoel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline_en_5.4.2_3.0_1724739393087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline_en_5.4.2_3.0_1724739393087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_undimoel_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/undimoel/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_en.md new file mode 100644 index 00000000000000..7d1cea5fbb7184 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_xlsum_english_portuguese T5Transformer from rdsmaia +author: John Snow Labs +name: mt5_small_finetuned_xlsum_english_portuguese +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xlsum_english_portuguese` is a English model originally trained by rdsmaia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_english_portuguese_en_5.4.2_3.0_1724738600207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_english_portuguese_en_5.4.2_3.0_1724738600207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_xlsum_english_portuguese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_xlsum_english_portuguese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xlsum_english_portuguese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/rdsmaia/mt5-small-finetuned-xlsum-en-pt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_pipeline_en.md new file mode 100644 index 00000000000000..f989fc6d1b6e6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_finetuned_xlsum_english_portuguese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_xlsum_english_portuguese_pipeline pipeline T5Transformer from rdsmaia +author: John Snow Labs +name: mt5_small_finetuned_xlsum_english_portuguese_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xlsum_english_portuguese_pipeline` is a English model originally trained by rdsmaia. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_english_portuguese_pipeline_en_5.4.2_3.0_1724738690292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_english_portuguese_pipeline_en_5.4.2_3.0_1724738690292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_xlsum_english_portuguese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_xlsum_english_portuguese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xlsum_english_portuguese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/rdsmaia/mt5-small-finetuned-xlsum-en-pt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_en.md new file mode 100644 index 00000000000000..53294d405dc7b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_en_5.4.2_3.0_1724732807595.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_en_5.4.2_3.0_1724732807595.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|746.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_pipeline_en.md new file mode 100644 index 00000000000000..3956c4a9c85c13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_frquad_qa_trimmed_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_pipeline_en_5.4.2_3.0_1724732855162.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_pipeline_en_5.4.2_3.0_1724732855162.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|746.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_en.md new file mode 100644 index 00000000000000..ae34ed13d04405 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ibn_shaddad_v3 T5Transformer from Ahmed007 +author: John Snow Labs +name: mt5_small_ibn_shaddad_v3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ibn_shaddad_v3` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ibn_shaddad_v3_en_5.4.2_3.0_1724742303122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ibn_shaddad_v3_en_5.4.2_3.0_1724742303122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ibn_shaddad_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ibn_shaddad_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ibn_shaddad_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Ahmed007/mt5-small-ibn-Shaddad-v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_pipeline_en.md new file mode 100644 index 00000000000000..97d7d989bfbc79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_ibn_shaddad_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ibn_shaddad_v3_pipeline pipeline T5Transformer from Ahmed007 +author: John Snow Labs +name: mt5_small_ibn_shaddad_v3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ibn_shaddad_v3_pipeline` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ibn_shaddad_v3_pipeline_en_5.4.2_3.0_1724742403421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ibn_shaddad_v3_pipeline_en_5.4.2_3.0_1724742403421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ibn_shaddad_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ibn_shaddad_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ibn_shaddad_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Ahmed007/mt5-small-ibn-Shaddad-v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_en.md new file mode 100644 index 00000000000000..a22886b6bbb442 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_qa_trimmed_italian_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qa_trimmed_italian_30000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qa_trimmed_italian_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_30000_en_5.4.2_3.0_1724741010972.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_30000_en_5.4.2_3.0_1724741010972.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qa_trimmed_italian_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qa_trimmed_italian_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qa_trimmed_italian_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qa-trimmed-it-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_pipeline_en.md new file mode 100644 index 00000000000000..eaca9db945a4c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qa_trimmed_italian_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_qa_trimmed_italian_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_itquad_qa_trimmed_italian_30000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qa_trimmed_italian_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_30000_pipeline_en_5.4.2_3.0_1724741027087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qa_trimmed_italian_30000_pipeline_en_5.4.2_3.0_1724741027087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qa_trimmed_italian_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qa_trimmed_italian_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qa_trimmed_italian_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-itquad-qa-trimmed-it-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..136631c45ca65f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_qg_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_ae_trimmed_50000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724765428896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724765428896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qg_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qg_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|433.1 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..d36244e0546129 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_qg_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_ae_trimmed_50000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724765451149.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724765451149.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qg_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qg_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|433.1 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_en.md new file mode 100644 index 00000000000000..16554fe205cca3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_koquad_qg_trimmed_korean_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qg_trimmed_korean_15000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qg_trimmed_korean_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qg_trimmed_korean_15000_en_5.4.2_3.0_1724739856904.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qg_trimmed_korean_15000_en_5.4.2_3.0_1724739856904.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_koquad_qg_trimmed_korean_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_koquad_qg_trimmed_korean_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qg_trimmed_korean_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|245.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qg-trimmed-ko-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_pipeline_en.md new file mode 100644 index 00000000000000..a78dfb7d57641a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_koquad_qg_trimmed_korean_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_koquad_qg_trimmed_korean_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qg_trimmed_korean_15000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qg_trimmed_korean_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qg_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724739869492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qg_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724739869492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_koquad_qg_trimmed_korean_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_koquad_qg_trimmed_korean_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qg_trimmed_korean_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|245.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qg-trimmed-ko-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_en.md new file mode 100644 index 00000000000000..9c9793d1ad0057 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_10k_enes T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_10k_enes +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_10k_enes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enes_en_5.4.2_3.0_1724722524634.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enes_en_5.4.2_3.0_1724722524634.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_10k_enes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_10k_enes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_10k_enes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-10k-enes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_pipeline_en.md new file mode 100644 index 00000000000000..4a4c8a741016cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_10k_enes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_10k_enes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_10k_enes_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_10k_enes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enes_pipeline_en_5.4.2_3.0_1724722708046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_10k_enes_pipeline_en_5.4.2_3.0_1724722708046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_10k_enes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_10k_enes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_10k_enes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-10k-enes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_en.md new file mode 100644 index 00000000000000..6dcae07bda97a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_250k_enru T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_enru +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_enru` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_enru_en_5.4.2_3.0_1724758858126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_enru_en_5.4.2_3.0_1724758858126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_250k_enru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_250k_enru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_enru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-enru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_pipeline_en.md new file mode 100644 index 00000000000000..cfcfe272f757cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_250k_enru_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_250k_enru_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_enru_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_enru_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_enru_pipeline_en_5.4.2_3.0_1724759016665.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_enru_pipeline_en_5.4.2_3.0_1724759016665.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_250k_enru_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_250k_enru_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_enru_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-enru + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_en.md new file mode 100644 index 00000000000000..53a5964f43cc9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_2k_deen T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_2k_deen +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_2k_deen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_deen_en_5.4.2_3.0_1724728187622.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_deen_en_5.4.2_3.0_1724728187622.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_2k_deen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_2k_deen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_2k_deen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-2k-deen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_pipeline_en.md new file mode 100644 index 00000000000000..5e07f230c27f11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_nc16_2k_deen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_2k_deen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_2k_deen_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_2k_deen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_deen_pipeline_en_5.4.2_3.0_1724728372138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_deen_pipeline_en_5.4.2_3.0_1724728372138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_2k_deen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_2k_deen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_2k_deen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-2k-deen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_en.md new file mode 100644 index 00000000000000..ec220c03e81e78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_rabbi_kook T5Transformer from ThatGuyVanquish +author: John Snow Labs +name: mt5_small_rabbi_kook +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_rabbi_kook` is a English model originally trained by ThatGuyVanquish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_rabbi_kook_en_5.4.2_3.0_1724769496789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_rabbi_kook_en_5.4.2_3.0_1724769496789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_rabbi_kook","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_rabbi_kook", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_rabbi_kook| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/ThatGuyVanquish/mt5-small-rabbi-kook \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_pipeline_en.md new file mode 100644 index 00000000000000..8bd08729974ea0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_rabbi_kook_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_rabbi_kook_pipeline pipeline T5Transformer from ThatGuyVanquish +author: John Snow Labs +name: mt5_small_rabbi_kook_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_rabbi_kook_pipeline` is a English model originally trained by ThatGuyVanquish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_rabbi_kook_pipeline_en_5.4.2_3.0_1724769687962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_rabbi_kook_pipeline_en_5.4.2_3.0_1724769687962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_rabbi_kook_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_rabbi_kook_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_rabbi_kook_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/ThatGuyVanquish/mt5-small-rabbi-kook + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_en.md new file mode 100644 index 00000000000000..add9d02ae2afff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_15000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_15000_en_5.4.2_3.0_1724717464093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_15000_en_5.4.2_3.0_1724717464093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|252.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_pipeline_en.md new file mode 100644 index 00000000000000..077e457fe3eefb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_15000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_15000_pipeline_en_5.4.2_3.0_1724717478179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_15000_pipeline_en_5.4.2_3.0_1724717478179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qa_trimmed_english_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qa_trimmed_english_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|252.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_en.md new file mode 100644 index 00000000000000..6c948b564b3981 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_60000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_60000_en_5.4.2_3.0_1724771904318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_60000_en_5.4.2_3.0_1724771904318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|484.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_pipeline_en.md new file mode 100644 index 00000000000000..1213de81e2595c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qa_trimmed_english_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_60000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724771932718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724771932718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qa_trimmed_english_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qa_trimmed_english_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|484.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_en.md new file mode 100644 index 00000000000000..6ab1b178e0e64f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_60000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_60000_en_5.4.2_3.0_1724761563781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_60000_en_5.4.2_3.0_1724761563781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|484.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_pipeline_en.md new file mode 100644 index 00000000000000..a9cfbb0cdbd2c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_squad_qg_trimmed_english_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_60000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724761590537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_60000_pipeline_en_5.4.2_3.0_1724761590537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qg_trimmed_english_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qg_trimmed_english_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|484.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_en.md new file mode 100644 index 00000000000000..bf7176cef58245 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_summarization_johnx69 T5Transformer from Johnx69 +author: John Snow Labs +name: mt5_small_summarization_johnx69 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_johnx69` is a English model originally trained by Johnx69. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_johnx69_en_5.4.2_3.0_1724734672627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_johnx69_en_5.4.2_3.0_1724734672627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_summarization_johnx69","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_summarization_johnx69", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_johnx69| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Johnx69/mt5_small_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_pipeline_en.md new file mode 100644 index 00000000000000..ae778171694015 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_summarization_johnx69_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_summarization_johnx69_pipeline pipeline T5Transformer from Johnx69 +author: John Snow Labs +name: mt5_small_summarization_johnx69_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_johnx69_pipeline` is a English model originally trained by Johnx69. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_johnx69_pipeline_en_5.4.2_3.0_1724734862140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_johnx69_pipeline_en_5.4.2_3.0_1724734862140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_summarization_johnx69_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_summarization_johnx69_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_johnx69_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Johnx69/mt5_small_summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_en.md new file mode 100644 index 00000000000000..0ba42bc34cb701 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_en_5.4.2_3.0_1724724097179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_en_5.4.2_3.0_1724724097179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|700.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_pipeline_en.md new file mode 100644 index 00000000000000..832b06f9721a35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_pipeline_en_5.4.2_3.0_1724724340239.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_pipeline_en_5.4.2_3.0_1724724340239.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|700.3 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_en.md new file mode 100644 index 00000000000000..1120d7b05c7992 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_french_120000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_en_5.4.2_3.0_1724718007010.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_en_5.4.2_3.0_1724718007010.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_pipeline_en.md new file mode 100644 index 00000000000000..57487fef778045 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_french_120000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724718159798.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724718159798.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_fr.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_fr.md new file mode 100644 index 00000000000000..bb9c91b5815917 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_60000_frquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_60000_frquad_qa +date: 2024-08-27 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_60000_frquad_qa` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qa_fr_5.4.2_3.0_1724745164656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qa_fr_5.4.2_3.0_1724745164656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_60000_frquad_qa","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_60000_frquad_qa", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_60000_frquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|458.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-60000-frquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_pipeline_fr.md new file mode 100644 index 00000000000000..7acbe2daffa8e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_french_60000_frquad_qa_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_60000_frquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_60000_frquad_qa_pipeline +date: 2024-08-27 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_60000_frquad_qa_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qa_pipeline_fr_5.4.2_3.0_1724745189361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_60000_frquad_qa_pipeline_fr_5.4.2_3.0_1724745189361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_60000_frquad_qa_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_60000_frquad_qa_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_60000_frquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|458.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-60000-frquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_en.md new file mode 100644 index 00000000000000..0bc76384e4c1bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_120000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_en_5.4.2_3.0_1724759532753.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_en_5.4.2_3.0_1724759532753.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_ja.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_ja.md new file mode 100644 index 00000000000000..b4b8f95e56a42d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_120000_jaquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000_jaquad_qa +date: 2024-08-27 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000_jaquad_qa` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qa_ja_5.4.2_3.0_1724770972514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qa_ja_5.4.2_3.0_1724770972514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000_jaquad_qa","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_120000_jaquad_qa", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000_jaquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|703.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000-jaquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja.md new file mode 100644 index 00000000000000..6432a3fedfbefa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline +date: 2024-08-27 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724771016574.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724771016574.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|703.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000-jaquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_pipeline_en.md new file mode 100644 index 00000000000000..b9639e3e4ccc08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_120000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_120000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_120000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_pipeline_en_5.4.2_3.0_1724759680406.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_120000_pipeline_en_5.4.2_3.0_1724759680406.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_ja.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_ja.md new file mode 100644 index 00000000000000..b323555b0dc764 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_30000_jaquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000_jaquad_qa +date: 2024-08-27 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000_jaquad_qa` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qa_ja_5.4.2_3.0_1724765066784.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qa_ja_5.4.2_3.0_1724765066784.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000_jaquad_qa","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_30000_jaquad_qa", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000_jaquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|326.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000-jaquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja.md new file mode 100644 index 00000000000000..0204faec68d6e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline +date: 2024-08-27 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724765083218.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja_5.4.2_3.0_1724765083218.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|326.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-30000-jaquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_en.md new file mode 100644 index 00000000000000..46bc922b099ccb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_translation_guyhadad01 T5Transformer from guyhadad01 +author: John Snow Labs +name: mt5_translation_guyhadad01 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_translation_guyhadad01` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_translation_guyhadad01_en_5.4.2_3.0_1724719606203.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_translation_guyhadad01_en_5.4.2_3.0_1724719606203.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_translation_guyhadad01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_translation_guyhadad01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_translation_guyhadad01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/guyhadad01/mt5-translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_pipeline_en.md new file mode 100644 index 00000000000000..80347404218a9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-mt5_translation_guyhadad01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_translation_guyhadad01_pipeline pipeline T5Transformer from guyhadad01 +author: John Snow Labs +name: mt5_translation_guyhadad01_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_translation_guyhadad01_pipeline` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_translation_guyhadad01_pipeline_en_5.4.2_3.0_1724719745538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_translation_guyhadad01_pipeline_en_5.4.2_3.0_1724719745538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_translation_guyhadad01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_translation_guyhadad01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_translation_guyhadad01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/guyhadad01/mt5-translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..0d1f4219b0167c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724738272467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724738272467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_without_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.7 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..32e69c006324aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724738290006.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724738290006.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_without_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.7 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_without_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_en.md b/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_en.md new file mode 100644 index 00000000000000..2dcbe4d3ff5fb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_order_nodes_without_edge_label_sentence_level_t5 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_order_nodes_without_edge_label_sentence_level_t5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_order_nodes_without_edge_label_sentence_level_t5` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_order_nodes_without_edge_label_sentence_level_t5_en_5.4.2_3.0_1724769392626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_order_nodes_without_edge_label_sentence_level_t5_en_5.4.2_3.0_1724769392626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_order_nodes_without_edge_label_sentence_level_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_order_nodes_without_edge_label_sentence_level_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_order_nodes_without_edge_label_sentence_level_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.9 MB| + +## References + +https://huggingface.co/sheoran95/normal_order_nodes_without_edge_label_sentence_level_T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en.md new file mode 100644 index 00000000000000..dcabb8817a0f9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_order_nodes_without_edge_label_sentence_level_t5_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_order_nodes_without_edge_label_sentence_level_t5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_order_nodes_without_edge_label_sentence_level_t5_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724769412126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724769412126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_order_nodes_without_edge_label_sentence_level_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_order_nodes_without_edge_label_sentence_level_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_order_nodes_without_edge_label_sentence_level_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.9 MB| + +## References + +https://huggingface.co/sheoran95/normal_order_nodes_without_edge_label_sentence_level_T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_en.md b/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_en.md new file mode 100644 index 00000000000000..a197077f8cf78c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ocrerrs T5Transformer from tmbdev +author: John Snow Labs +name: ocrerrs +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ocrerrs` is a English model originally trained by tmbdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ocrerrs_en_5.4.2_3.0_1724759615356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ocrerrs_en_5.4.2_3.0_1724759615356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ocrerrs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ocrerrs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ocrerrs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tmbdev/ocrerrs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_pipeline_en.md new file mode 100644 index 00000000000000..6fad13ea350d76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-ocrerrs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ocrerrs_pipeline pipeline T5Transformer from tmbdev +author: John Snow Labs +name: ocrerrs_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ocrerrs_pipeline` is a English model originally trained by tmbdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ocrerrs_pipeline_en_5.4.2_3.0_1724759666835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ocrerrs_pipeline_en_5.4.2_3.0_1724759666835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ocrerrs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ocrerrs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ocrerrs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tmbdev/ocrerrs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-omodel_en.md b/docs/_posts/ahmedlone127/2024-08-27-omodel_en.md new file mode 100644 index 00000000000000..f4d32eb4e58cbf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-omodel_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English omodel T5Transformer from justinlamlamlam +author: John Snow Labs +name: omodel +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`omodel` is a English model originally trained by justinlamlamlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/omodel_en_5.4.2_3.0_1724732443541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/omodel_en_5.4.2_3.0_1724732443541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("omodel","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("omodel", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|omodel| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/justinlamlamlam/omodel \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-omodel_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-omodel_pipeline_en.md new file mode 100644 index 00000000000000..2892c027a7e8da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-omodel_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English omodel_pipeline pipeline T5Transformer from justinlamlamlam +author: John Snow Labs +name: omodel_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`omodel_pipeline` is a English model originally trained by justinlamlamlam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/omodel_pipeline_en_5.4.2_3.0_1724732490446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/omodel_pipeline_en_5.4.2_3.0_1724732490446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("omodel_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("omodel_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|omodel_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/justinlamlamlam/omodel + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_en.md new file mode 100644 index 00000000000000..84f0a4f4004a8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pet_mt5_base T5Transformer from nikoyo +author: John Snow Labs +name: pet_mt5_base +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pet_mt5_base` is a English model originally trained by nikoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pet_mt5_base_en_5.4.2_3.0_1724748786003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pet_mt5_base_en_5.4.2_3.0_1724748786003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pet_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pet_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pet_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/nikoyo/pet-mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_pipeline_en.md new file mode 100644 index 00000000000000..4f4cc494a3d470 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-pet_mt5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pet_mt5_base_pipeline pipeline T5Transformer from nikoyo +author: John Snow Labs +name: pet_mt5_base_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pet_mt5_base_pipeline` is a English model originally trained by nikoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pet_mt5_base_pipeline_en_5.4.2_3.0_1724749079986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pet_mt5_base_pipeline_en_5.4.2_3.0_1724749079986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pet_mt5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pet_mt5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pet_mt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/nikoyo/pet-mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-postocr_en.md b/docs/_posts/ahmedlone127/2024-08-27-postocr_en.md new file mode 100644 index 00000000000000..05b8699d884df9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-postocr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English postocr T5Transformer from floriancaro +author: John Snow Labs +name: postocr +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`postocr` is a English model originally trained by floriancaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/postocr_en_5.4.2_3.0_1724742919806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/postocr_en_5.4.2_3.0_1724742919806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("postocr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("postocr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|postocr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|282.0 MB| + +## References + +https://huggingface.co/floriancaro/postocr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-postocr_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-postocr_pipeline_en.md new file mode 100644 index 00000000000000..264f5ce08bbd42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-postocr_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English postocr_pipeline pipeline T5Transformer from floriancaro +author: John Snow Labs +name: postocr_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`postocr_pipeline` is a English model originally trained by floriancaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/postocr_pipeline_en_5.4.2_3.0_1724742943468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/postocr_pipeline_en_5.4.2_3.0_1724742943468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("postocr_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("postocr_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|postocr_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|282.0 MB| + +## References + +https://huggingface.co/floriancaro/postocr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qg_english_en.md b/docs/_posts/ahmedlone127/2024-08-27-qg_english_en.md new file mode 100644 index 00000000000000..00e828fd05689c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qg_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qg_english T5Transformer from supercat666 +author: John Snow Labs +name: qg_english +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qg_english` is a English model originally trained by supercat666. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qg_english_en_5.4.2_3.0_1724725979630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qg_english_en_5.4.2_3.0_1724725979630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qg_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qg_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qg_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/supercat666/qg_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_en.md new file mode 100644 index 00000000000000..29adf8d1d32453 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qqp_t5_large_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_large_seed_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_large_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_3_en_5.4.2_3.0_1724733248805.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_3_en_5.4.2_3.0_1724733248805.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qqp_t5_large_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qqp_t5_large_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_large_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-large_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..70b1b969cbd85f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_large_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qqp_t5_large_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_large_seed_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_large_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724733420518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724733420518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qqp_t5_large_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qqp_t5_large_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_large_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-large_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_en.md new file mode 100644 index 00000000000000..28ba4f1929b334 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qqp_t5_small_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_small_seed_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_small_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_small_seed_1_en_5.4.2_3.0_1724729893361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_small_seed_1_en_5.4.2_3.0_1724729893361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qqp_t5_small_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qqp_t5_small_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_small_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.8 MB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-small_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..8d366331dce181 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qqp_t5_small_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qqp_t5_small_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_small_seed_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_small_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724729913697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724729913697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qqp_t5_small_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qqp_t5_small_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_small_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.8 MB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-small_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qt5_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-qt5_small_en.md new file mode 100644 index 00000000000000..712b9e0db1a81b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qt5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qt5_small T5Transformer from pyterrier-quality +author: John Snow Labs +name: qt5_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qt5_small` is a English model originally trained by pyterrier-quality. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qt5_small_en_5.4.2_3.0_1724766268248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qt5_small_en_5.4.2_3.0_1724766268248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qt5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qt5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.1 MB| + +## References + +https://huggingface.co/pyterrier-quality/qt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-qt5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-qt5_small_pipeline_en.md new file mode 100644 index 00000000000000..bdc150eff886ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-qt5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qt5_small_pipeline pipeline T5Transformer from pyterrier-quality +author: John Snow Labs +name: qt5_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qt5_small_pipeline` is a English model originally trained by pyterrier-quality. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qt5_small_pipeline_en_5.4.2_3.0_1724766290708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qt5_small_pipeline_en_5.4.2_3.0_1724766290708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qt5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qt5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.1 MB| + +## References + +https://huggingface.co/pyterrier-quality/qt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-quizbot_en.md b/docs/_posts/ahmedlone127/2024-08-27-quizbot_en.md new file mode 100644 index 00000000000000..4344a10fee8e91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-quizbot_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English quizbot T5Transformer from Ravi6923 +author: John Snow Labs +name: quizbot +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot` is a English model originally trained by Ravi6923. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_en_5.4.2_3.0_1724721479394.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_en_5.4.2_3.0_1724721479394.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("quizbot","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("quizbot", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/Ravi6923/QuizBot \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-quizbot_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-quizbot_pipeline_en.md new file mode 100644 index 00000000000000..8129133d1a9f97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-quizbot_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English quizbot_pipeline pipeline T5Transformer from Ravi6923 +author: John Snow Labs +name: quizbot_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot_pipeline` is a English model originally trained by Ravi6923. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_pipeline_en_5.4.2_3.0_1724721496724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_pipeline_en_5.4.2_3.0_1724721496724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("quizbot_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("quizbot_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/Ravi6923/QuizBot + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_en.md b/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_en.md new file mode 100644 index 00000000000000..f97da86de2b0a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English r1_iterater T5Transformer from owanr +author: John Snow Labs +name: r1_iterater +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`r1_iterater` is a English model originally trained by owanr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/r1_iterater_en_5.4.2_3.0_1724748101282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/r1_iterater_en_5.4.2_3.0_1724748101282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("r1_iterater","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("r1_iterater", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|r1_iterater| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/owanr/r1_iterater \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_pipeline_en.md new file mode 100644 index 00000000000000..60d6200d55ead7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-r1_iterater_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English r1_iterater_pipeline pipeline T5Transformer from owanr +author: John Snow Labs +name: r1_iterater_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`r1_iterater_pipeline` is a English model originally trained by owanr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/r1_iterater_pipeline_en_5.4.2_3.0_1724748267905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/r1_iterater_pipeline_en_5.4.2_3.0_1724748267905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("r1_iterater_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("r1_iterater_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|r1_iterater_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/owanr/r1_iterater + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_en.md new file mode 100644 index 00000000000000..6ba60477266ac4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_300_500syn_root_cause_gen_t5_base T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_500syn_root_cause_gen_t5_base +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_500syn_root_cause_gen_t5_base` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_500syn_root_cause_gen_t5_base_en_5.4.2_3.0_1724740907568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_500syn_root_cause_gen_t5_base_en_5.4.2_3.0_1724740907568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_300_500syn_root_cause_gen_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_300_500syn_root_cause_gen_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_500syn_root_cause_gen_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-500syn-root_cause-gen-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..3d941be89440df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-real_prompt_300_500syn_root_cause_gen_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English real_prompt_300_500syn_root_cause_gen_t5_base_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_300_500syn_root_cause_gen_t5_base_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_300_500syn_root_cause_gen_t5_base_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_300_500syn_root_cause_gen_t5_base_pipeline_en_5.4.2_3.0_1724741079088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_300_500syn_root_cause_gen_t5_base_pipeline_en_5.4.2_3.0_1724741079088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("real_prompt_300_500syn_root_cause_gen_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("real_prompt_300_500syn_root_cause_gen_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_300_500syn_root_cause_gen_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-300-500syn-root_cause-gen-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-results2_en.md b/docs/_posts/ahmedlone127/2024-08-27-results2_en.md new file mode 100644 index 00000000000000..f327b912bc7ca8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-results2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results2 T5Transformer from akum1343 +author: John Snow Labs +name: results2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results2` is a English model originally trained by akum1343. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results2_en_5.4.2_3.0_1724769538187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results2_en_5.4.2_3.0_1724769538187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|274.8 MB| + +## References + +https://huggingface.co/akum1343/results2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-results2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-results2_pipeline_en.md new file mode 100644 index 00000000000000..459c0ac8272194 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-results2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results2_pipeline pipeline T5Transformer from akum1343 +author: John Snow Labs +name: results2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results2_pipeline` is a English model originally trained by akum1343. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results2_pipeline_en_5.4.2_3.0_1724769565516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results2_pipeline_en_5.4.2_3.0_1724769565516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|274.8 MB| + +## References + +https://huggingface.co/akum1343/results2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_en.md b/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_en.md new file mode 100644 index 00000000000000..cecd73dd11ef04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rulec2_nvp40 T5Transformer from mika5883 +author: John Snow Labs +name: rulec2_nvp40 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulec2_nvp40` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulec2_nvp40_en_5.4.2_3.0_1724742510744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulec2_nvp40_en_5.4.2_3.0_1724742510744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rulec2_nvp40","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rulec2_nvp40", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulec2_nvp40| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULEC2_NVP40 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_pipeline_en.md new file mode 100644 index 00000000000000..d94cc3abdc4279 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-rulec2_nvp40_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rulec2_nvp40_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: rulec2_nvp40_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulec2_nvp40_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulec2_nvp40_pipeline_en_5.4.2_3.0_1724742556359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulec2_nvp40_pipeline_en_5.4.2_3.0_1724742556359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rulec2_nvp40_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rulec2_nvp40_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulec2_nvp40_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULEC2_NVP40 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_en.md b/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_en.md new file mode 100644 index 00000000000000..b7c5a19c0704dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English russian_t5_model_for_law_simplification T5Transformer from marcus2000 +author: John Snow Labs +name: russian_t5_model_for_law_simplification +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`russian_t5_model_for_law_simplification` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/russian_t5_model_for_law_simplification_en_5.4.2_3.0_1724762492524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/russian_t5_model_for_law_simplification_en_5.4.2_3.0_1724762492524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("russian_t5_model_for_law_simplification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("russian_t5_model_for_law_simplification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|russian_t5_model_for_law_simplification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/marcus2000/ru_t5_model_for_law_simplification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_pipeline_en.md new file mode 100644 index 00000000000000..959293c125d8ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-russian_t5_model_for_law_simplification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English russian_t5_model_for_law_simplification_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: russian_t5_model_for_law_simplification_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`russian_t5_model_for_law_simplification_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/russian_t5_model_for_law_simplification_pipeline_en_5.4.2_3.0_1724762541158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/russian_t5_model_for_law_simplification_pipeline_en_5.4.2_3.0_1724762541158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("russian_t5_model_for_law_simplification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("russian_t5_model_for_law_simplification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|russian_t5_model_for_law_simplification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/marcus2000/ru_t5_model_for_law_simplification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_en.md b/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_en.md new file mode 100644 index 00000000000000..4c3c07095d1753 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_simple_aphasia_lvl1 T5Transformer from ShinjuM +author: John Snow Labs +name: rut5_base_simple_aphasia_lvl1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_simple_aphasia_lvl1` is a English model originally trained by ShinjuM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl1_en_5.4.2_3.0_1724765140404.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl1_en_5.4.2_3.0_1724765140404.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_simple_aphasia_lvl1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_simple_aphasia_lvl1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_simple_aphasia_lvl1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.7 MB| + +## References + +https://huggingface.co/ShinjuM/rut5-base-simple-aphasia-lvl1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_pipeline_en.md new file mode 100644 index 00000000000000..0002167281e1ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-rut5_base_simple_aphasia_lvl1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_simple_aphasia_lvl1_pipeline pipeline T5Transformer from ShinjuM +author: John Snow Labs +name: rut5_base_simple_aphasia_lvl1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_simple_aphasia_lvl1_pipeline` is a English model originally trained by ShinjuM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl1_pipeline_en_5.4.2_3.0_1724765186475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl1_pipeline_en_5.4.2_3.0_1724765186475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_simple_aphasia_lvl1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_simple_aphasia_lvl1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_simple_aphasia_lvl1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.7 MB| + +## References + +https://huggingface.co/ShinjuM/rut5-base-simple-aphasia-lvl1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_en.md new file mode 100644 index 00000000000000..5880167795602a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English salient_aiflan_t5_small T5Transformer from pratt3000 +author: John Snow Labs +name: salient_aiflan_t5_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`salient_aiflan_t5_small` is a English model originally trained by pratt3000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/salient_aiflan_t5_small_en_5.4.2_3.0_1724763430240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/salient_aiflan_t5_small_en_5.4.2_3.0_1724763430240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("salient_aiflan_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("salient_aiflan_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|salient_aiflan_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/pratt3000/Salient_aiflan-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..7d14be639dc659 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-salient_aiflan_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English salient_aiflan_t5_small_pipeline pipeline T5Transformer from pratt3000 +author: John Snow Labs +name: salient_aiflan_t5_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`salient_aiflan_t5_small_pipeline` is a English model originally trained by pratt3000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/salient_aiflan_t5_small_pipeline_en_5.4.2_3.0_1724763451586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/salient_aiflan_t5_small_pipeline_en_5.4.2_3.0_1724763451586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("salient_aiflan_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("salient_aiflan_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|salient_aiflan_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/pratt3000/Salient_aiflan-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_en.md new file mode 100644 index 00000000000000..85ea5483c97cbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sapol_coqe_vit5_large_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: sapol_coqe_vit5_large_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sapol_coqe_vit5_large_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_large_v2_en_5.4.2_3.0_1724723883662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_large_v2_en_5.4.2_3.0_1724723883662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sapol_coqe_vit5_large_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sapol_coqe_vit5_large_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sapol_coqe_vit5_large_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SAPOL_COQE_viT5-large_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_pipeline_en.md new file mode 100644 index 00000000000000..5aff3c3b40fed3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sapol_coqe_vit5_large_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sapol_coqe_vit5_large_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: sapol_coqe_vit5_large_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sapol_coqe_vit5_large_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_large_v2_pipeline_en_5.4.2_3.0_1724724074036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_large_v2_pipeline_en_5.4.2_3.0_1724724074036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sapol_coqe_vit5_large_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sapol_coqe_vit5_large_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sapol_coqe_vit5_large_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SAPOL_COQE_viT5-large_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_en.md b/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_en.md new file mode 100644 index 00000000000000..5a2b8abffe249e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scifive_medquad_question_generation T5Transformer from AnonymousSub +author: John Snow Labs +name: scifive_medquad_question_generation +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_medquad_question_generation` is a English model originally trained by AnonymousSub. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_medquad_question_generation_en_5.4.2_3.0_1724759197295.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_medquad_question_generation_en_5.4.2_3.0_1724759197295.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scifive_medquad_question_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scifive_medquad_question_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_medquad_question_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSub/SciFive_MedQuAD_question_generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_pipeline_en.md new file mode 100644 index 00000000000000..110ff945acc0f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-scifive_medquad_question_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scifive_medquad_question_generation_pipeline pipeline T5Transformer from AnonymousSub +author: John Snow Labs +name: scifive_medquad_question_generation_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_medquad_question_generation_pipeline` is a English model originally trained by AnonymousSub. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_medquad_question_generation_pipeline_en_5.4.2_3.0_1724759245010.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_medquad_question_generation_pipeline_en_5.4.2_3.0_1724759245010.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scifive_medquad_question_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scifive_medquad_question_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_medquad_question_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSub/SciFive_MedQuAD_question_generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sft_mt5_pile_ner_test_seq2seq_format_en.md b/docs/_posts/ahmedlone127/2024-08-27-sft_mt5_pile_ner_test_seq2seq_format_en.md new file mode 100644 index 00000000000000..cc3cc38d734e94 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sft_mt5_pile_ner_test_seq2seq_format_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_mt5_pile_ner_test_seq2seq_format T5Transformer from nqv2291 +author: John Snow Labs +name: sft_mt5_pile_ner_test_seq2seq_format +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_mt5_pile_ner_test_seq2seq_format` is a English model originally trained by nqv2291. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_seq2seq_format_en_5.4.2_3.0_1724757675413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_mt5_pile_ner_test_seq2seq_format_en_5.4.2_3.0_1724757675413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_mt5_pile_ner_test_seq2seq_format","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_mt5_pile_ner_test_seq2seq_format", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_mt5_pile_ner_test_seq2seq_format| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/nqv2291/sft_mt5-Pile-NER-test-seq2seq-format \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..96cdbe8a54cdfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724768983760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724768983760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|315.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_augmented_graphs_with_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..b630e5149fdfc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724769001547.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724769001547.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|315.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_augmented_graphs_with_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_en.md new file mode 100644 index 00000000000000..7eecd93a821220 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724723259610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_en_5.4.2_3.0_1724723259610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline_en.md new file mode 100644 index 00000000000000..854c2d8bc3997d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724723279905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline_en_5.4.2_3.0_1724723279905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..5659585c46d89a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724771887718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724771887718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.4 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..999fb9311c9cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724771907043.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724771907043.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.4 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sno_empty_ja.md b/docs/_posts/ahmedlone127/2024-08-27-sno_empty_ja.md new file mode 100644 index 00000000000000..d2be494781b469 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sno_empty_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese sno_empty T5Transformer from Roy029 +author: John Snow Labs +name: sno_empty +date: 2024-08-27 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_empty` is a Japanese model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_empty_ja_5.4.2_3.0_1724737428957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_empty_ja_5.4.2_3.0_1724737428957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sno_empty","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sno_empty", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_empty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|945.3 MB| + +## References + +https://huggingface.co/Roy029/sno_empty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sno_empty_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-27-sno_empty_pipeline_ja.md new file mode 100644 index 00000000000000..bcfabed8747fe5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sno_empty_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese sno_empty_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: sno_empty_pipeline +date: 2024-08-27 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_empty_pipeline` is a Japanese model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_empty_pipeline_ja_5.4.2_3.0_1724737494622.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_empty_pipeline_ja_5.4.2_3.0_1724737494622.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sno_empty_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sno_empty_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_empty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|945.3 MB| + +## References + +https://huggingface.co/Roy029/sno_empty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_en.md b/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_en.md new file mode 100644 index 00000000000000..93f61972d3746e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sno_py2500 T5Transformer from Roy029 +author: John Snow Labs +name: sno_py2500 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_py2500` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_py2500_en_5.4.2_3.0_1724717548242.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_py2500_en_5.4.2_3.0_1724717548242.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sno_py2500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sno_py2500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_py2500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|951.7 MB| + +## References + +https://huggingface.co/Roy029/sno_py2500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_pipeline_en.md new file mode 100644 index 00000000000000..c7215926eaeebc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sno_py2500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sno_py2500_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: sno_py2500_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_py2500_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_py2500_pipeline_en_5.4.2_3.0_1724717617502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_py2500_pipeline_en_5.4.2_3.0_1724717617502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sno_py2500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sno_py2500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_py2500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|951.7 MB| + +## References + +https://huggingface.co/Roy029/sno_py2500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_en.md b/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_en.md new file mode 100644 index 00000000000000..5d69aeae18b867 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English soapl_coqe_vit5_large_test60 T5Transformer from ThuyNT03 +author: John Snow Labs +name: soapl_coqe_vit5_large_test60 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`soapl_coqe_vit5_large_test60` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test60_en_5.4.2_3.0_1724731166977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test60_en_5.4.2_3.0_1724731166977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("soapl_coqe_vit5_large_test60","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("soapl_coqe_vit5_large_test60", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|soapl_coqe_vit5_large_test60| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SOAPL_COQE_viT5-large_test60 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_pipeline_en.md new file mode 100644 index 00000000000000..d1d3edfaa8dfaf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-soapl_coqe_vit5_large_test60_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English soapl_coqe_vit5_large_test60_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: soapl_coqe_vit5_large_test60_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`soapl_coqe_vit5_large_test60_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test60_pipeline_en_5.4.2_3.0_1724731335640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/soapl_coqe_vit5_large_test60_pipeline_en_5.4.2_3.0_1724731335640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("soapl_coqe_vit5_large_test60_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("soapl_coqe_vit5_large_test60_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|soapl_coqe_vit5_large_test60_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SOAPL_COQE_viT5-large_test60 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_en.md new file mode 100644 index 00000000000000..121856b5e4c475 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English spanish_uc_modelo_npl_e3_v2 T5Transformer from JuanForeroNeme +author: John Snow Labs +name: spanish_uc_modelo_npl_e3_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_uc_modelo_npl_e3_v2` is a English model originally trained by JuanForeroNeme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v2_en_5.4.2_3.0_1724755078402.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v2_en_5.4.2_3.0_1724755078402.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spanish_uc_modelo_npl_e3_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spanish_uc_modelo_npl_e3_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_uc_modelo_npl_e3_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanForeroNeme/ES_UC_MODELO_NPL_E3_V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_pipeline_en.md new file mode 100644 index 00000000000000..526f9c2e441f5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-spanish_uc_modelo_npl_e3_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English spanish_uc_modelo_npl_e3_v2_pipeline pipeline T5Transformer from JuanForeroNeme +author: John Snow Labs +name: spanish_uc_modelo_npl_e3_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spanish_uc_modelo_npl_e3_v2_pipeline` is a English model originally trained by JuanForeroNeme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v2_pipeline_en_5.4.2_3.0_1724755130676.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spanish_uc_modelo_npl_e3_v2_pipeline_en_5.4.2_3.0_1724755130676.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spanish_uc_modelo_npl_e3_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spanish_uc_modelo_npl_e3_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spanish_uc_modelo_npl_e3_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JuanForeroNeme/ES_UC_MODELO_NPL_E3_V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_en.md b/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_en.md new file mode 100644 index 00000000000000..6e5d57ba30a1e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speech_chatgpt_base_arabic_t5 T5Transformer from kuanhuggingface +author: John Snow Labs +name: speech_chatgpt_base_arabic_t5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speech_chatgpt_base_arabic_t5` is a English model originally trained by kuanhuggingface. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speech_chatgpt_base_arabic_t5_en_5.4.2_3.0_1724729864138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speech_chatgpt_base_arabic_t5_en_5.4.2_3.0_1724729864138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speech_chatgpt_base_arabic_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speech_chatgpt_base_arabic_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speech_chatgpt_base_arabic_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kuanhuggingface/speech-chatgpt-base-ar-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_pipeline_en.md new file mode 100644 index 00000000000000..d172c345e53926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speech_chatgpt_base_arabic_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speech_chatgpt_base_arabic_t5_pipeline pipeline T5Transformer from kuanhuggingface +author: John Snow Labs +name: speech_chatgpt_base_arabic_t5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speech_chatgpt_base_arabic_t5_pipeline` is a English model originally trained by kuanhuggingface. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speech_chatgpt_base_arabic_t5_pipeline_en_5.4.2_3.0_1724729918159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speech_chatgpt_base_arabic_t5_pipeline_en_5.4.2_3.0_1724729918159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speech_chatgpt_base_arabic_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speech_chatgpt_base_arabic_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speech_chatgpt_base_arabic_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kuanhuggingface/speech-chatgpt-base-ar-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_en.md new file mode 100644 index 00000000000000..a3a0ae674ceb8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_big_3 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_3` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_3_en_5.4.2_3.0_1724773119133.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_3_en_5.4.2_3.0_1724773119133.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_big_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_big_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_pipeline_en.md new file mode 100644 index 00000000000000..65414fe68cb2c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_big_3_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_3_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_3_pipeline_en_5.4.2_3.0_1724773169000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_3_pipeline_en_5.4.2_3.0_1724773169000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_big_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_big_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_en.md b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_en.md new file mode 100644 index 00000000000000..5deed5412adf61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_big_6 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_6 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_6` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_6_en_5.4.2_3.0_1724765881488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_6_en_5.4.2_3.0_1724765881488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_big_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_big_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_pipeline_en.md new file mode 100644 index 00000000000000..8815e578e87977 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-speller_t5_big_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_big_6_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_6_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_6_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_6_pipeline_en_5.4.2_3.0_1724765934962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_6_pipeline_en_5.4.2_3.0_1724765934962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_big_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_big_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_en.md new file mode 100644 index 00000000000000..69ae688deb8f01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English srt5_small_finetuned_summarizer T5Transformer from malbasha98 +author: John Snow Labs +name: srt5_small_finetuned_summarizer +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srt5_small_finetuned_summarizer` is a English model originally trained by malbasha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srt5_small_finetuned_summarizer_en_5.4.2_3.0_1724744158933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srt5_small_finetuned_summarizer_en_5.4.2_3.0_1724744158933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("srt5_small_finetuned_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("srt5_small_finetuned_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srt5_small_finetuned_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/malbasha98/srt5-small-finetuned-summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..051c806efe582b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-srt5_small_finetuned_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English srt5_small_finetuned_summarizer_pipeline pipeline T5Transformer from malbasha98 +author: John Snow Labs +name: srt5_small_finetuned_summarizer_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srt5_small_finetuned_summarizer_pipeline` is a English model originally trained by malbasha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srt5_small_finetuned_summarizer_pipeline_en_5.4.2_3.0_1724744174491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srt5_small_finetuned_summarizer_pipeline_en_5.4.2_3.0_1724744174491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("srt5_small_finetuned_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("srt5_small_finetuned_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srt5_small_finetuned_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/malbasha98/srt5-small-finetuned-summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..67a3fd9cf3aed5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sst2_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_base_seed_3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_3_en_5.4.2_3.0_1724717869343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_3_en_5.4.2_3.0_1724717869343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sst2_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sst2_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|953.5 MB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..ea9a0c79493920 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sst2_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sst2_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: sst2_t5_base_seed_3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sst2_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724717933920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sst2_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724717933920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sst2_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sst2_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sst2_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|953.5 MB| + +## References + +https://huggingface.co/utahnlp/sst2_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_en.md b/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_en.md new file mode 100644 index 00000000000000..138952b807e8ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_lr2e_3_20epoch T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr2e_3_20epoch +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr2e_3_20epoch` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr2e_3_20epoch_en_5.4.2_3.0_1724770010618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr2e_3_20epoch_en_5.4.2_3.0_1724770010618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_lr2e_3_20epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_lr2e_3_20epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr2e_3_20epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|420.3 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr2e_3_20epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_pipeline_en.md new file mode 100644 index 00000000000000..d13d6975742f08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-sum_model_lr2e_3_20epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_lr2e_3_20epoch_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr2e_3_20epoch_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr2e_3_20epoch_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr2e_3_20epoch_pipeline_en_5.4.2_3.0_1724770033393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr2e_3_20epoch_pipeline_en_5.4.2_3.0_1724770033393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_lr2e_3_20epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_lr2e_3_20epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr2e_3_20epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|420.3 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr2e_3_20epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_en.md b/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_en.md new file mode 100644 index 00000000000000..6c7808195a5bf4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_mesh_background_conclusion T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_mesh_background_conclusion +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_mesh_background_conclusion` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_background_conclusion_en_5.4.2_3.0_1724723211354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_background_conclusion_en_5.4.2_3.0_1724723211354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_mesh_background_conclusion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_mesh_background_conclusion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_mesh_background_conclusion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_mesh_background_conclusion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline_en.md new file mode 100644 index 00000000000000..65b14b1b4d1162 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline_en_5.4.2_3.0_1724723263211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline_en_5.4.2_3.0_1724723263211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_mesh_background_conclusion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_mesh_background_conclusion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-svd_en.md b/docs/_posts/ahmedlone127/2024-08-27-svd_en.md new file mode 100644 index 00000000000000..8bd2b87032e6c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-svd_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English svd T5Transformer from Rhasan97 +author: John Snow Labs +name: svd +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`svd` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/svd_en_5.4.2_3.0_1724770880868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/svd_en_5.4.2_3.0_1724770880868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("svd","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("svd", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|svd| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/Rhasan97/svd \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-svd_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-svd_pipeline_en.md new file mode 100644 index 00000000000000..781d02b3cdd92f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-svd_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English svd_pipeline pipeline T5Transformer from Rhasan97 +author: John Snow Labs +name: svd_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`svd_pipeline` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/svd_pipeline_en_5.4.2_3.0_1724770940765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/svd_pipeline_en_5.4.2_3.0_1724770940765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("svd_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("svd_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|svd_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/Rhasan97/svd + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_en.md b/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_en.md new file mode 100644 index 00000000000000..b39719e7309ada --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t52_ishwarbb23 T5Transformer from ishwarbb23 +author: John Snow Labs +name: t52_ishwarbb23 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t52_ishwarbb23` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t52_ishwarbb23_en_5.4.2_3.0_1724752508817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t52_ishwarbb23_en_5.4.2_3.0_1724752508817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t52_ishwarbb23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t52_ishwarbb23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t52_ishwarbb23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t52 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_pipeline_en.md new file mode 100644 index 00000000000000..8ce9b9f5b9d4de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t52_ishwarbb23_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t52_ishwarbb23_pipeline pipeline T5Transformer from ishwarbb23 +author: John Snow Labs +name: t52_ishwarbb23_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t52_ishwarbb23_pipeline` is a English model originally trained by ishwarbb23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t52_ishwarbb23_pipeline_en_5.4.2_3.0_1724752556904.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t52_ishwarbb23_pipeline_en_5.4.2_3.0_1724752556904.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t52_ishwarbb23_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t52_ishwarbb23_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t52_ishwarbb23_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ishwarbb23/t52 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_en.md new file mode 100644 index 00000000000000..42b6c6a3a067ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_1_en_5.4.2_3.0_1724768755781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_1_en_5.4.2_3.0_1724768755781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_pipeline_en.md new file mode 100644 index 00000000000000..1cf1c3d4ddf3f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2012_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_1_pipeline_en_5.4.2_3.0_1724768773506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_1_pipeline_en_5.4.2_3.0_1724768773506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_en.md new file mode 100644 index 00000000000000..4191a1a26b9e79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_10 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_10_en_5.4.2_3.0_1724771885913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_10_en_5.4.2_3.0_1724771885913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_pipeline_en.md new file mode 100644 index 00000000000000..6fdb48120e37e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_10_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_10_pipeline_en_5.4.2_3.0_1724771903562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_10_pipeline_en_5.4.2_3.0_1724771903562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_en.md new file mode 100644 index 00000000000000..bb362a9084d412 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_4_en_5.4.2_3.0_1724759822705.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_4_en_5.4.2_3.0_1724759822705.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_pipeline_en.md new file mode 100644 index 00000000000000..b0c88f039ca73e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_4_pipeline_en_5.4.2_3.0_1724759839110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_4_pipeline_en_5.4.2_3.0_1724759839110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_en.md new file mode 100644 index 00000000000000..3cbc5265e903bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_8 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_8_en_5.4.2_3.0_1724739970830.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_8_en_5.4.2_3.0_1724739970830.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_pipeline_en.md new file mode 100644 index 00000000000000..9f41396775b997 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2013_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_8_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_8_pipeline_en_5.4.2_3.0_1724739987506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_8_pipeline_en_5.4.2_3.0_1724739987506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_en.md new file mode 100644 index 00000000000000..e6ae6f147a34d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_1_en_5.4.2_3.0_1724729617526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_1_en_5.4.2_3.0_1724729617526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_pipeline_en.md new file mode 100644 index 00000000000000..ca01c10fad2e44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2014_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_1_pipeline_en_5.4.2_3.0_1724729634025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_1_pipeline_en_5.4.2_3.0_1724729634025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_en.md new file mode 100644 index 00000000000000..b073cb2b46ce57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_10 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_10_en_5.4.2_3.0_1724749267781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_10_en_5.4.2_3.0_1724749267781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_pipeline_en.md new file mode 100644 index 00000000000000..0e285af5f9311a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2016_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_10_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_10_pipeline_en_5.4.2_3.0_1724749284372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_10_pipeline_en_5.4.2_3.0_1724749284372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_en.md new file mode 100644 index 00000000000000..f9f1de4632bf96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_8 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_8_en_5.4.2_3.0_1724743911028.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_8_en_5.4.2_3.0_1724743911028.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_pipeline_en.md new file mode 100644 index 00000000000000..4a1bf2b85c9361 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2020_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_8_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_8_pipeline_en_5.4.2_3.0_1724743929414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_8_pipeline_en_5.4.2_3.0_1724743929414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_en.md new file mode 100644 index 00000000000000..2a24f49a0af720 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_2_en_5.4.2_3.0_1724764576305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_2_en_5.4.2_3.0_1724764576305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_pipeline_en.md new file mode 100644 index 00000000000000..b4bd302c2d4ea5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_lm_wmt_2021_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_2_pipeline_en_5.4.2_3.0_1724764593501.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_2_pipeline_en_5.4.2_3.0_1724764593501.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_en.md new file mode 100644 index 00000000000000..e5900f5efee8bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_8 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_8_en_5.4.2_3.0_1724753960077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_8_en_5.4.2_3.0_1724753960077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_pipeline_en.md new file mode 100644 index 00000000000000..2184299bfa9e98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2015_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_8_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_8_pipeline_en_5.4.2_3.0_1724753988540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_8_pipeline_en_5.4.2_3.0_1724753988540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_en.md new file mode 100644 index 00000000000000..61e4e4dd040d63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_9 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_9_en_5.4.2_3.0_1724743081386.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_9_en_5.4.2_3.0_1724743081386.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_pipeline_en.md new file mode 100644 index 00000000000000..d3ebe8baf45aa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_60m_poli_aff_2017_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_9_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_9_pipeline_en_5.4.2_3.0_1724743109011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_9_pipeline_en_5.4.2_3.0_1724743109011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.9 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_7m_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_7m_en.md new file mode 100644 index 00000000000000..678bbf67ef0df7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_7m_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_7m T5Transformer from versae +author: John Snow Labs +name: t5_7m +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_7m` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_7m_en_5.4.2_3.0_1724756101696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_7m_en_5.4.2_3.0_1724756101696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_7m","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_7m", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_7m| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-7m \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_7m_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_7m_pipeline_en.md new file mode 100644 index 00000000000000..cd3b82b2d10d2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_7m_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_7m_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_7m_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_7m_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_7m_pipeline_en_5.4.2_3.0_1724756152535.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_7m_pipeline_en_5.4.2_3.0_1724756152535.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_7m_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_7m_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_7m_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-7m + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base2_en.md new file mode 100644 index 00000000000000..1e0c2aa7b23780 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base2 T5Transformer from paopow +author: John Snow Labs +name: t5_base2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base2` is a English model originally trained by paopow. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base2_en_5.4.2_3.0_1724720784182.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base2_en_5.4.2_3.0_1724720784182.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/paopow/t5_base2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base2_pipeline_en.md new file mode 100644 index 00000000000000..f1c9108defe12e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base2_pipeline pipeline T5Transformer from paopow +author: John Snow Labs +name: t5_base2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base2_pipeline` is a English model originally trained by paopow. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base2_pipeline_en_5.4.2_3.0_1724721074171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base2_pipeline_en_5.4.2_3.0_1724721074171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/paopow/t5_base2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_en.md new file mode 100644 index 00000000000000..d8d8a7d196b350 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_bt3 T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt3 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt3` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt3_en_5.4.2_3.0_1724742348305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt3_en_5.4.2_3.0_1724742348305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_bt3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_bt3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_pipeline_en.md new file mode 100644 index 00000000000000..f1ebf005c36461 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_bt3_pipeline pipeline T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt3_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt3_pipeline` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt3_pipeline_en_5.4.2_3.0_1724742397575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt3_pipeline_en_5.4.2_3.0_1724742397575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_bt3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_bt3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_en.md new file mode 100644 index 00000000000000..3ea551ffa1f066 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_bt5_1000 T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt5_1000 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt5_1000` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt5_1000_en_5.4.2_3.0_1724738353939.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt5_1000_en_5.4.2_3.0_1724738353939.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_bt5_1000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_bt5_1000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt5_1000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt5-1000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_pipeline_en.md new file mode 100644 index 00000000000000..46c3dfecbe42d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_bt5_1000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_bt5_1000_pipeline pipeline T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt5_1000_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt5_1000_pipeline` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt5_1000_pipeline_en_5.4.2_3.0_1724738402745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt5_1000_pipeline_en_5.4.2_3.0_1724738402745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_bt5_1000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_bt5_1000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt5_1000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt5-1000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_en.md new file mode 100644 index 00000000000000..8fd406c7d069cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_2lrouter T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_2lrouter +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_2lrouter` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_2lrouter_en_5.4.2_3.0_1724763023714.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_2lrouter_en_5.4.2_3.0_1724763023714.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_2lrouter","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_2lrouter", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_2lrouter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_2Lrouter \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en.md new file mode 100644 index 00000000000000..152b7642857a89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en_5.4.2_3.0_1724763169351.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en_5.4.2_3.0_1724763169351.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_2Lrouter + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..0ce2501946fa41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724720831341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724720831341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|945.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-128-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..5ae00e190d6d60 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724720898607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724720898607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_128_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|945.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-128-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_en.md new file mode 100644 index 00000000000000..a75b70c32babb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724732078038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724732078038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|931.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..4fe77c870e3b40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724732149465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724732149465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|931.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_en.md new file mode 100644 index 00000000000000..f3228de436eb6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724741947292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724741947292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|931.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..cd4f941306cff9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724742016443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724742016443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_infilling_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|931.4 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-infilling-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_en.md new file mode 100644 index 00000000000000..83d97fdfe059a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724731223535.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_en_5.4.2_3.0_1724731223535.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|954.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..123d764b24dd11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724731286513.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline_en_5.4.2_3.0_1724731286513.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|954.1 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_en.md new file mode 100644 index 00000000000000..7baf3f69f142cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_on_eredat_kelm_q1_epoch10 T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_finetuned_on_eredat_kelm_q1_epoch10 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_on_eredat_kelm_q1_epoch10` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q1_epoch10_en_5.4.2_3.0_1724749364654.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q1_epoch10_en_5.4.2_3.0_1724749364654.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_on_eredat_kelm_q1_epoch10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_on_eredat_kelm_q1_epoch10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_on_eredat_kelm_q1_epoch10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/OneFly7/T5-base-finetuned-on-eredat-kelm-Q1-epoch10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline_en.md new file mode 100644 index 00000000000000..524d73854f1439 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline pipeline T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline_en_5.4.2_3.0_1724749413695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline_en_5.4.2_3.0_1724749413695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_on_eredat_kelm_q1_epoch10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/OneFly7/T5-base-finetuned-on-eredat-kelm-Q1-epoch10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_en.md new file mode 100644 index 00000000000000..9458178085b22e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_long_livedoor_news_corpus_ktokunaga T5Transformer from ktokunaga +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_ktokunaga +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_ktokunaga` is a English model originally trained by ktokunaga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ktokunaga_en_5.4.2_3.0_1724755082450.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ktokunaga_en_5.4.2_3.0_1724755082450.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus_ktokunaga","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_long_livedoor_news_corpus_ktokunaga", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_ktokunaga| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ktokunaga/t5-base-long-livedoor-news-corpus \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en.md new file mode 100644 index 00000000000000..dcb58091e393d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_long_livedoor_news_corpus_ktokunaga_pipeline pipeline T5Transformer from ktokunaga +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_ktokunaga_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_ktokunaga_pipeline` is a English model originally trained by ktokunaga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en_5.4.2_3.0_1724755130459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en_5.4.2_3.0_1724755130459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_livedoor_news_corpus_ktokunaga_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_livedoor_news_corpus_ktokunaga_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_ktokunaga_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ktokunaga/t5-base-long-livedoor-news-corpus + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_en.md new file mode 100644 index 00000000000000..a1aa16f253b7c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_multi_combine_wiki_news_airklizz T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_multi_combine_wiki_news_airklizz +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_multi_combine_wiki_news_airklizz` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_multi_combine_wiki_news_airklizz_en_5.4.2_3.0_1724755661108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_multi_combine_wiki_news_airklizz_en_5.4.2_3.0_1724755661108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_multi_combine_wiki_news_airklizz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_multi_combine_wiki_news_airklizz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_multi_combine_wiki_news_airklizz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/airKlizz/t5-base-multi-combine-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_pipeline_en.md new file mode 100644 index 00000000000000..3e537a8de51bee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_multi_combine_wiki_news_airklizz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_multi_combine_wiki_news_airklizz_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: t5_base_multi_combine_wiki_news_airklizz_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_multi_combine_wiki_news_airklizz_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_multi_combine_wiki_news_airklizz_pipeline_en_5.4.2_3.0_1724755710698.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_multi_combine_wiki_news_airklizz_pipeline_en_5.4.2_3.0_1724755710698.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_multi_combine_wiki_news_airklizz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_multi_combine_wiki_news_airklizz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_multi_combine_wiki_news_airklizz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/airKlizz/t5-base-multi-combine-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_en.md new file mode 100644 index 00000000000000..5a71890e14180f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_ncc_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_normail +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_normail_en_5.4.2_3.0_1724744044802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_normail_en_5.4.2_3.0_1724744044802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ncc_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ncc_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_pipeline_en.md new file mode 100644 index 00000000000000..7cbdbab5130237 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_ncc_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_ncc_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_normail_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_normail_pipeline_en_5.4.2_3.0_1724744176928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_normail_pipeline_en_5.4.2_3.0_1724744176928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ncc_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ncc_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_nhksum_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_nhksum_1_en.md new file mode 100644 index 00000000000000..e24e4b14173118 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_nhksum_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_nhksum_1 T5Transformer from p1atdev +author: John Snow Labs +name: t5_base_nhksum_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_nhksum_1` is a English model originally trained by p1atdev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_nhksum_1_en_5.4.2_3.0_1724731536817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_nhksum_1_en_5.4.2_3.0_1724731536817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_nhksum_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_nhksum_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_nhksum_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|516.8 MB| + +## References + +https://huggingface.co/p1atdev/t5-base-nhksum-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_en.md new file mode 100644 index 00000000000000..33944925029ad0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qasper T5Transformer from irenepap +author: John Snow Labs +name: t5_base_qasper +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qasper` is a English model originally trained by irenepap. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qasper_en_5.4.2_3.0_1724745769105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qasper_en_5.4.2_3.0_1724745769105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qasper","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qasper", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qasper| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.5 MB| + +## References + +https://huggingface.co/irenepap/t5-base-qasper \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_pipeline_en.md new file mode 100644 index 00000000000000..f2c92300470704 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_qasper_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qasper_pipeline pipeline T5Transformer from irenepap +author: John Snow Labs +name: t5_base_qasper_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qasper_pipeline` is a English model originally trained by irenepap. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qasper_pipeline_en_5.4.2_3.0_1724745827913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qasper_pipeline_en_5.4.2_3.0_1724745827913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qasper_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qasper_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qasper_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.5 MB| + +## References + +https://huggingface.co/irenepap/t5-base-qasper + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_en.md new file mode 100644 index 00000000000000..2806072d597577 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_tfidf_phones T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_tfidf_phones +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_tfidf_phones` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_phones_en_5.4.2_3.0_1724731132772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_phones_en_5.4.2_3.0_1724731132772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_tfidf_phones","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_tfidf_phones", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_tfidf_phones| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|975.3 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-tfidf-phones \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_pipeline_en.md new file mode 100644 index 00000000000000..3d5afbdf4c2450 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_rlhf_tfidf_phones_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_tfidf_phones_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_tfidf_phones_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_tfidf_phones_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_phones_pipeline_en_5.4.2_3.0_1724731189996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_phones_pipeline_en_5.4.2_3.0_1724731189996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_tfidf_phones_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_tfidf_phones_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_tfidf_phones_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|975.3 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-tfidf-phones + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_en.md new file mode 100644 index 00000000000000..b6a1e3ed38f295 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed42 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed42 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed42` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed42_en_5.4.2_3.0_1724761005411.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed42_en_5.4.2_3.0_1724761005411.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed42","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed42", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed42| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed42 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en.md new file mode 100644 index 00000000000000..7aec5577052cef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en_5.4.2_3.0_1724761052237.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en_5.4.2_3.0_1724761052237.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed42 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_en.md new file mode 100644 index 00000000000000..5e1b6ce66409d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_beauty T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_beauty +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_beauty` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_beauty_en_5.4.2_3.0_1724750327289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_beauty_en_5.4.2_3.0_1724750327289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_beauty","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_beauty", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_beauty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.1 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-beauty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_pipeline_en.md new file mode 100644 index 00000000000000..c8c5385f129cf5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_beauty_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_beauty_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_beauty_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_beauty_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_beauty_pipeline_en_5.4.2_3.0_1724750382146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_beauty_pipeline_en_5.4.2_3.0_1724750382146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_beauty_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_beauty_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_beauty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.1 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-beauty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_en.md new file mode 100644 index 00000000000000..fa51bc0c2a1ad4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_tools T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_tools +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_tools` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_tools_en_5.4.2_3.0_1724728777729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_tools_en_5.4.2_3.0_1724728777729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_tools","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_tools", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_tools| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-tools \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_pipeline_en.md new file mode 100644 index 00000000000000..9ce4d5a0c5e9ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_sft_tools_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_tools_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_tools_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_tools_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_tools_pipeline_en_5.4.2_3.0_1724728831369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_tools_pipeline_en_5.4.2_3.0_1724728831369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_tools_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_tools_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_tools_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-tools + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_en.md new file mode 100644 index 00000000000000..5cea2e4eec777a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_9rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_9rear +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_9rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_9rear_en_5.4.2_3.0_1724728689967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_9rear_en_5.4.2_3.0_1724728689967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_9rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_9rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_9rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-9rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_pipeline_en.md new file mode 100644 index 00000000000000..9c997290d48056 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_0front_1body_9rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_9rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_9rear_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_9rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_9rear_pipeline_en_5.4.2_3.0_1724728738095.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_9rear_pipeline_en_5.4.2_3.0_1724728738095.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_9rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_9rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_9rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-9rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_en.md new file mode 100644 index 00000000000000..b20d346b7ed1aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_7front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_7front_1body_0rear +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_7front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_7front_1body_0rear_en_5.4.2_3.0_1724736329979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_7front_1body_0rear_en_5.4.2_3.0_1724736329979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_7front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_7front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_7front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-7front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..c7b991a6e11c4a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tedxjp_7front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_7front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_7front_1body_0rear_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_7front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_7front_1body_0rear_pipeline_en_5.4.2_3.0_1724736381372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_7front_1body_0rear_pipeline_en_5.4.2_3.0_1724736381372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_7front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_7front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_7front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-7front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_en.md new file mode 100644 index 00000000000000..a54f2cdc1dadc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_title T5Transformer from Swarnava +author: John Snow Labs +name: t5_base_title +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_title` is a English model originally trained by Swarnava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_title_en_5.4.2_3.0_1724762545211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_title_en_5.4.2_3.0_1724762545211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_title","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_title", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_title| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.1 MB| + +## References + +https://huggingface.co/Swarnava/T5_base_title \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_pipeline_en.md new file mode 100644 index 00000000000000..be05ff910e1531 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_title_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_title_pipeline pipeline T5Transformer from Swarnava +author: John Snow Labs +name: t5_base_title_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_title_pipeline` is a English model originally trained by Swarnava. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_title_pipeline_en_5.4.2_3.0_1724762598541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_title_pipeline_en_5.4.2_3.0_1724762598541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_title_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_title_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_title_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.1 MB| + +## References + +https://huggingface.co/Swarnava/T5_base_title + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_en.md new file mode 100644 index 00000000000000..c614003be6560f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed33 T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed33 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed33` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed33_en_5.4.2_3.0_1724752039558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed33_en_5.4.2_3.0_1724752039558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed33","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed33", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed33| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.7 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed33 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_pipeline_en.md new file mode 100644 index 00000000000000..447475e840a645 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_base_tweetsumm_seed33_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed33_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed33_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed33_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed33_pipeline_en_5.4.2_3.0_1724752086486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed33_pipeline_en_5.4.2_3.0_1724752086486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsumm_seed33_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsumm_seed33_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed33_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.8 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed33 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_en.md new file mode 100644 index 00000000000000..59b948cfd9c993 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_cnndm_ryusangwon T5Transformer from ryusangwon +author: John Snow Labs +name: t5_cnndm_ryusangwon +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_cnndm_ryusangwon` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_cnndm_ryusangwon_en_5.4.2_3.0_1724730138472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_cnndm_ryusangwon_en_5.4.2_3.0_1724730138472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_cnndm_ryusangwon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_cnndm_ryusangwon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_cnndm_ryusangwon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryusangwon/t5-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_pipeline_en.md new file mode 100644 index 00000000000000..c19d89c4b3311a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_cnndm_ryusangwon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_cnndm_ryusangwon_pipeline pipeline T5Transformer from ryusangwon +author: John Snow Labs +name: t5_cnndm_ryusangwon_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_cnndm_ryusangwon_pipeline` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_cnndm_ryusangwon_pipeline_en_5.4.2_3.0_1724730190202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_cnndm_ryusangwon_pipeline_en_5.4.2_3.0_1724730190202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_cnndm_ryusangwon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_cnndm_ryusangwon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_cnndm_ryusangwon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryusangwon/t5-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_en.md new file mode 100644 index 00000000000000..36d09d12acaddc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_dialogue_classification_3_kmanaa T5Transformer from kmanaa +author: John Snow Labs +name: t5_dialogue_classification_3_kmanaa +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_classification_3_kmanaa` is a English model originally trained by kmanaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_3_kmanaa_en_5.4.2_3.0_1724772462513.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_3_kmanaa_en_5.4.2_3.0_1724772462513.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialogue_classification_3_kmanaa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialogue_classification_3_kmanaa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_classification_3_kmanaa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kmanaa/t5-dialogue-classification-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_pipeline_en.md new file mode 100644 index 00000000000000..0712e86cdd6b29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_dialogue_classification_3_kmanaa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_dialogue_classification_3_kmanaa_pipeline pipeline T5Transformer from kmanaa +author: John Snow Labs +name: t5_dialogue_classification_3_kmanaa_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_classification_3_kmanaa_pipeline` is a English model originally trained by kmanaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_3_kmanaa_pipeline_en_5.4.2_3.0_1724772508833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_classification_3_kmanaa_pipeline_en_5.4.2_3.0_1724772508833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialogue_classification_3_kmanaa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialogue_classification_3_kmanaa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_classification_3_kmanaa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kmanaa/t5-dialogue-classification-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_en.md new file mode 100644 index 00000000000000..96804265844555 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_f_experiment_0 T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_0` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_0_en_5.4.2_3.0_1724733071067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_0_en_5.4.2_3.0_1724733071067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_f_experiment_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_f_experiment_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|294.4 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_pipeline_en.md new file mode 100644 index 00000000000000..912816d822a902 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_f_experiment_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_f_experiment_0_pipeline pipeline T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_0_pipeline` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_0_pipeline_en_5.4.2_3.0_1724733097011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_0_pipeline_en_5.4.2_3.0_1724733097011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_f_experiment_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_f_experiment_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|294.4 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_en.md new file mode 100644 index 00000000000000..9b8a255a4b5a0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetune_cnndaily_news_sumsum_minddigger008 T5Transformer from minddigger008 +author: John Snow Labs +name: t5_finetune_cnndaily_news_sumsum_minddigger008 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_cnndaily_news_sumsum_minddigger008` is a English model originally trained by minddigger008. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_minddigger008_en_5.4.2_3.0_1724772127635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_minddigger008_en_5.4.2_3.0_1724772127635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetune_cnndaily_news_sumsum_minddigger008","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetune_cnndaily_news_sumsum_minddigger008", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_cnndaily_news_sumsum_minddigger008| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/minddigger008/t5-finetune-cnndaily-news-sumsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en.md new file mode 100644 index 00000000000000..cfb0ec506543cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline pipeline T5Transformer from minddigger008 +author: John Snow Labs +name: t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline` is a English model originally trained by minddigger008. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en_5.4.2_3.0_1724772144751.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en_5.4.2_3.0_1724772144751.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/minddigger008/t5-finetune-cnndaily-news-sumsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_en.md new file mode 100644 index 00000000000000..a7267f8dfe2c52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_lang_translation T5Transformer from Vinitrajputt +author: John Snow Labs +name: t5_lang_translation +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_lang_translation` is a English model originally trained by Vinitrajputt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_lang_translation_en_5.4.2_3.0_1724717233290.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_lang_translation_en_5.4.2_3.0_1724717233290.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_lang_translation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_lang_translation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_lang_translation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vinitrajputt/t5-lang-translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_pipeline_en.md new file mode 100644 index 00000000000000..742357bc0752c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_lang_translation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_lang_translation_pipeline pipeline T5Transformer from Vinitrajputt +author: John Snow Labs +name: t5_lang_translation_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_lang_translation_pipeline` is a English model originally trained by Vinitrajputt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_lang_translation_pipeline_en_5.4.2_3.0_1724717282850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_lang_translation_pipeline_en_5.4.2_3.0_1724717282850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_lang_translation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_lang_translation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_lang_translation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vinitrajputt/t5-lang-translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_arxiv_title_abstract_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_arxiv_title_abstract_en.md new file mode 100644 index 00000000000000..7bfb41e284c427 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_arxiv_title_abstract_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_arxiv_title_abstract T5Transformer from pbmstrk +author: John Snow Labs +name: t5_large_arxiv_title_abstract +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_arxiv_title_abstract` is a English model originally trained by pbmstrk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_title_abstract_en_5.4.2_3.0_1724726026166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_arxiv_title_abstract_en_5.4.2_3.0_1724726026166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_arxiv_title_abstract","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_arxiv_title_abstract", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_arxiv_title_abstract| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pbmstrk/t5-large-arxiv-title-abstract \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_en.md new file mode 100644 index 00000000000000..31d9beb28efef3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_iirc_retrieved T5Transformer from StonyBrookNLP +author: John Snow Labs +name: t5_large_iirc_retrieved +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_iirc_retrieved` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_iirc_retrieved_en_5.4.2_3.0_1724757861484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_iirc_retrieved_en_5.4.2_3.0_1724757861484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_iirc_retrieved","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_iirc_retrieved", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_iirc_retrieved| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/t5-large-iirc-retrieved \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_pipeline_en.md new file mode 100644 index 00000000000000..f94b40fde4876b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_iirc_retrieved_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_iirc_retrieved_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: t5_large_iirc_retrieved_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_iirc_retrieved_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_iirc_retrieved_pipeline_en_5.4.2_3.0_1724758003371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_iirc_retrieved_pipeline_en_5.4.2_3.0_1724758003371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_iirc_retrieved_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_iirc_retrieved_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_iirc_retrieved_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/StonyBrookNLP/t5-large-iirc-retrieved + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_en.md new file mode 100644 index 00000000000000..d4f4536801f6e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_lm_adapt_2wikimultihopqa T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_2wikimultihopqa +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_2wikimultihopqa` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_2wikimultihopqa_en_5.4.2_3.0_1724721659167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_2wikimultihopqa_en_5.4.2_3.0_1724721659167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_lm_adapt_2wikimultihopqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_lm_adapt_2wikimultihopqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_2wikimultihopqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-2wikimultihopqa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_pipeline_en.md new file mode 100644 index 00000000000000..7dc4aa1dbed3ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_2wikimultihopqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_lm_adapt_2wikimultihopqa_pipeline pipeline T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_2wikimultihopqa_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_2wikimultihopqa_pipeline` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_2wikimultihopqa_pipeline_en_5.4.2_3.0_1724721828645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_2wikimultihopqa_pipeline_en_5.4.2_3.0_1724721828645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_lm_adapt_2wikimultihopqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_lm_adapt_2wikimultihopqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_2wikimultihopqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-2wikimultihopqa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_en.md new file mode 100644 index 00000000000000..77875135fe47cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_lm_adapt_hotpotqa_distractor T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_hotpotqa_distractor +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_hotpotqa_distractor` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_hotpotqa_distractor_en_5.4.2_3.0_1724732542743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_hotpotqa_distractor_en_5.4.2_3.0_1724732542743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_lm_adapt_hotpotqa_distractor","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_lm_adapt_hotpotqa_distractor", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_hotpotqa_distractor| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-hotpotqa-distractor \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_pipeline_en.md new file mode 100644 index 00000000000000..0a3be5b7c76074 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_lm_adapt_hotpotqa_distractor_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_lm_adapt_hotpotqa_distractor_pipeline pipeline T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_hotpotqa_distractor_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_hotpotqa_distractor_pipeline` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_hotpotqa_distractor_pipeline_en_5.4.2_3.0_1724732684852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_hotpotqa_distractor_pipeline_en_5.4.2_3.0_1724732684852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_lm_adapt_hotpotqa_distractor_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_lm_adapt_hotpotqa_distractor_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_hotpotqa_distractor_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-hotpotqa-distractor + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_en.md new file mode 100644 index 00000000000000..6e23bcad46b8e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_paws T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_paws +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_paws` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_paws_en_5.4.2_3.0_1724735772559.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_paws_en_5.4.2_3.0_1724735772559.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_paws","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_paws", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_paws| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-paws \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_pipeline_en.md new file mode 100644 index 00000000000000..a398541bbf735b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_paws_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_paws_pipeline pipeline T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_large_paws_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_paws_pipeline` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_paws_pipeline_en_5.4.2_3.0_1724735921767.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_paws_pipeline_en_5.4.2_3.0_1724735921767.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_paws_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_paws_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_paws_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/SeongwooKim/T5-large-paws + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_readme_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_readme_summarization_en.md new file mode 100644 index 00000000000000..9dd29d9dc6c45c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_readme_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_readme_summarization T5Transformer from bunbohue +author: John Snow Labs +name: t5_large_readme_summarization +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_readme_summarization` is a English model originally trained by bunbohue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_readme_summarization_en_5.4.2_3.0_1724774925956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_readme_summarization_en_5.4.2_3.0_1724774925956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_readme_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_readme_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_readme_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/bunbohue/t5-large_readme_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_en.md new file mode 100644 index 00000000000000..f1ed23687bf2f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_squadshifts_reddit_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squadshifts_reddit_qg +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squadshifts_reddit_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_reddit_qg_en_5.4.2_3.0_1724754208271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_reddit_qg_en_5.4.2_3.0_1724754208271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_squadshifts_reddit_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_squadshifts_reddit_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squadshifts_reddit_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squadshifts-reddit-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_pipeline_en.md new file mode 100644 index 00000000000000..b9af9ad64afab4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_large_squadshifts_reddit_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_squadshifts_reddit_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_squadshifts_reddit_qg_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squadshifts_reddit_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_reddit_qg_pipeline_en_5.4.2_3.0_1724754339672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squadshifts_reddit_qg_pipeline_en_5.4.2_3.0_1724754339672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_squadshifts_reddit_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_squadshifts_reddit_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squadshifts_reddit_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-squadshifts-reddit-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_en.md new file mode 100644 index 00000000000000..f06dc5535db608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_d_6 T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_d_6 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_d_6` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_d_6_en_5.4.2_3.0_1724749488460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_d_6_en_5.4.2_3.0_1724749488460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_d_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_d_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_d_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.8 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-d-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_pipeline_en.md new file mode 100644 index 00000000000000..3e253a76548c22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_model_1_d_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_d_6_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_d_6_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_d_6_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_d_6_pipeline_en_5.4.2_3.0_1724749537324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_d_6_pipeline_en_5.4.2_3.0_1724749537324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_d_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_d_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_d_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.8 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-d-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_recommendation_sports_equipment_english_tmukande12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_recommendation_sports_equipment_english_tmukande12_pipeline_en.md new file mode 100644 index 00000000000000..eb9ae1a838a2be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_recommendation_sports_equipment_english_tmukande12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_tmukande12_pipeline pipeline T5Transformer from tmukande12 +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_tmukande12_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_tmukande12_pipeline` is a English model originally trained by tmukande12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_tmukande12_pipeline_en_5.4.2_3.0_1724716954420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_tmukande12_pipeline_en_5.4.2_3.0_1724716954420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_sports_equipment_english_tmukande12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_sports_equipment_english_tmukande12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_tmukande12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/tmukande12/t5_recommendation_sports_equipment_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_en.md new file mode 100644 index 00000000000000..60054843245c08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_rls500 T5Transformer from marcus2000 +author: John Snow Labs +name: t5_rls500 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rls500` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rls500_en_5.4.2_3.0_1724751842330.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rls500_en_5.4.2_3.0_1724751842330.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_rls500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rls500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rls500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/marcus2000/T5-RLS500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_pipeline_en.md new file mode 100644 index 00000000000000..46bbd9e87f1788 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_rls500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_rls500_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: t5_rls500_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rls500_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rls500_pipeline_en_5.4.2_3.0_1724751889446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rls500_pipeline_en_5.4.2_3.0_1724751889446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_rls500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_rls500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rls500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.4 MB| + +## References + +https://huggingface.co/marcus2000/T5-RLS500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_en.md new file mode 100644 index 00000000000000..a2e112cbf1a423 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_act2pas_pushparaj2811 T5Transformer from Pushparaj2811 +author: John Snow Labs +name: t5_small_act2pas_pushparaj2811 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_act2pas_pushparaj2811` is a English model originally trained by Pushparaj2811. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_act2pas_pushparaj2811_en_5.4.2_3.0_1724743655962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_act2pas_pushparaj2811_en_5.4.2_3.0_1724743655962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_act2pas_pushparaj2811","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_act2pas_pushparaj2811", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_act2pas_pushparaj2811| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/Pushparaj2811/t5-small-act2pas \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_pipeline_en.md new file mode 100644 index 00000000000000..daee7e3408e5d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_act2pas_pushparaj2811_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_act2pas_pushparaj2811_pipeline pipeline T5Transformer from Pushparaj2811 +author: John Snow Labs +name: t5_small_act2pas_pushparaj2811_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_act2pas_pushparaj2811_pipeline` is a English model originally trained by Pushparaj2811. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_act2pas_pushparaj2811_pipeline_en_5.4.2_3.0_1724743673550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_act2pas_pushparaj2811_pipeline_en_5.4.2_3.0_1724743673550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_act2pas_pushparaj2811_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_act2pas_pushparaj2811_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_act2pas_pushparaj2811_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/Pushparaj2811/t5-small-act2pas + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_en.md new file mode 100644 index 00000000000000..0b4680355e9180 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_alpaca T5Transformer from reasonwang +author: John Snow Labs +name: t5_small_alpaca +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_alpaca` is a English model originally trained by reasonwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_alpaca_en_5.4.2_3.0_1724772003772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_alpaca_en_5.4.2_3.0_1724772003772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_alpaca","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_alpaca", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_alpaca| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/reasonwang/t5-small-alpaca \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_pipeline_en.md new file mode 100644 index 00000000000000..a8d2bf492faaca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_alpaca_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_alpaca_pipeline pipeline T5Transformer from reasonwang +author: John Snow Labs +name: t5_small_alpaca_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_alpaca_pipeline` is a English model originally trained by reasonwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_alpaca_pipeline_en_5.4.2_3.0_1724772023340.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_alpaca_pipeline_en_5.4.2_3.0_1724772023340.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_alpaca_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_alpaca_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_alpaca_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/reasonwang/t5-small-alpaca + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_en.md new file mode 100644 index 00000000000000..c06ae25840f606 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_en_5.4.2_3.0_1724755310861.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_en_5.4.2_3.0_1724755310861.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_pipeline_en.md new file mode 100644 index 00000000000000..fbf5b0105554c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_codesearchnet_multilang_python_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_pipeline_en_5.4.2_3.0_1724755368994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_pipeline_en_5.4.2_3.0_1724755368994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_codesearchnet_multilang_python_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_codesearchnet_multilang_python_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_en.md new file mode 100644 index 00000000000000..9cb800a0adf444 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_bias_267d8789 T5Transformer from ajsmith201 +author: John Snow Labs +name: t5_small_finetuned_bias_267d8789 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_bias_267d8789` is a English model originally trained by ajsmith201. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_267d8789_en_5.4.2_3.0_1724752113510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_267d8789_en_5.4.2_3.0_1724752113510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_bias_267d8789","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_bias_267d8789", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_bias_267d8789| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.9 MB| + +## References + +https://huggingface.co/ajsmith201/t5-small-finetuned-bias-267d8789 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_pipeline_en.md new file mode 100644 index 00000000000000..1dbe86ee5de608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_bias_267d8789_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_bias_267d8789_pipeline pipeline T5Transformer from ajsmith201 +author: John Snow Labs +name: t5_small_finetuned_bias_267d8789_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_bias_267d8789_pipeline` is a English model originally trained by ajsmith201. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_267d8789_pipeline_en_5.4.2_3.0_1724752134783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_267d8789_pipeline_en_5.4.2_3.0_1724752134783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_bias_267d8789_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_bias_267d8789_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_bias_267d8789_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.9 MB| + +## References + +https://huggingface.co/ajsmith201/t5-small-finetuned-bias-267d8789 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_en.md new file mode 100644 index 00000000000000..d2098ae8f8f374 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_dailymail_sudolife T5Transformer from sudoLife +author: John Snow Labs +name: t5_small_finetuned_cnn_dailymail_sudolife +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_dailymail_sudolife` is a English model originally trained by sudoLife. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_dailymail_sudolife_en_5.4.2_3.0_1724749399386.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_dailymail_sudolife_en_5.4.2_3.0_1724749399386.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_dailymail_sudolife","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_dailymail_sudolife", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_dailymail_sudolife| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/sudoLife/t5-small-finetuned-cnn_dailymail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_pipeline_en.md new file mode 100644 index 00000000000000..e031b2ff9b668f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_cnn_dailymail_sudolife_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_dailymail_sudolife_pipeline pipeline T5Transformer from sudoLife +author: John Snow Labs +name: t5_small_finetuned_cnn_dailymail_sudolife_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_dailymail_sudolife_pipeline` is a English model originally trained by sudoLife. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_dailymail_sudolife_pipeline_en_5.4.2_3.0_1724749415547.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_dailymail_sudolife_pipeline_en_5.4.2_3.0_1724749415547.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_cnn_dailymail_sudolife_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_cnn_dailymail_sudolife_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_dailymail_sudolife_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/sudoLife/t5-small-finetuned-cnn_dailymail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en.md new file mode 100644 index 00000000000000..5ee30b57f8b474 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf T5Transformer from danhsf +author: John Snow Labs +name: t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en_5.4.2_3.0_1724760784968.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en_5.4.2_3.0_1724760784968.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.6 MB| + +## References + +https://huggingface.co/danhsf/t5-small-finetuned-ro-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en.md new file mode 100644 index 00000000000000..6639d583b9db13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline pipeline T5Transformer from danhsf +author: John Snow Labs +name: t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en_5.4.2_3.0_1724760802066.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en_5.4.2_3.0_1724760802066.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.6 MB| + +## References + +https://huggingface.co/danhsf/t5-small-finetuned-ro-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_en.md new file mode 100644 index 00000000000000..1381a6e04572ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_ajscalers T5Transformer from ajscalers +author: John Snow Labs +name: t5_small_finetuned_xsum_ajscalers +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_ajscalers` is a English model originally trained by ajscalers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ajscalers_en_5.4.2_3.0_1724731865770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ajscalers_en_5.4.2_3.0_1724731865770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_ajscalers","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_ajscalers", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_ajscalers| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.6 MB| + +## References + +https://huggingface.co/ajscalers/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_pipeline_en.md new file mode 100644 index 00000000000000..b7e37ccb3e5cb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_ajscalers_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_ajscalers_pipeline pipeline T5Transformer from ajscalers +author: John Snow Labs +name: t5_small_finetuned_xsum_ajscalers_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_ajscalers_pipeline` is a English model originally trained by ajscalers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ajscalers_pipeline_en_5.4.2_3.0_1724731886368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ajscalers_pipeline_en_5.4.2_3.0_1724731886368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_ajscalers_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_ajscalers_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_ajscalers_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.6 MB| + +## References + +https://huggingface.co/ajscalers/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_en.md new file mode 100644 index 00000000000000..5e8d16053aa0e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_taeseon T5Transformer from taeseon +author: John Snow Labs +name: t5_small_finetuned_xsum_taeseon +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_taeseon` is a English model originally trained by taeseon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_taeseon_en_5.4.2_3.0_1724720808826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_taeseon_en_5.4.2_3.0_1724720808826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_taeseon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_taeseon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_taeseon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/taeseon/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_pipeline_en.md new file mode 100644 index 00000000000000..f64524860aaf0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_taeseon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_taeseon_pipeline pipeline T5Transformer from taeseon +author: John Snow Labs +name: t5_small_finetuned_xsum_taeseon_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_taeseon_pipeline` is a English model originally trained by taeseon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_taeseon_pipeline_en_5.4.2_3.0_1724720827457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_taeseon_pipeline_en_5.4.2_3.0_1724720827457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_taeseon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_taeseon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_taeseon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/taeseon/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_en.md new file mode 100644 index 00000000000000..a115368907d636 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_vigneshwar0803 T5Transformer from Vigneshwar0803 +author: John Snow Labs +name: t5_small_finetuned_xsum_vigneshwar0803 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_vigneshwar0803` is a English model originally trained by Vigneshwar0803. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_vigneshwar0803_en_5.4.2_3.0_1724764743828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_vigneshwar0803_en_5.4.2_3.0_1724764743828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_vigneshwar0803","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_vigneshwar0803", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_vigneshwar0803| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/Vigneshwar0803/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_pipeline_en.md new file mode 100644 index 00000000000000..9530b552244439 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_vigneshwar0803_pipeline pipeline T5Transformer from Vigneshwar0803 +author: John Snow Labs +name: t5_small_finetuned_xsum_vigneshwar0803_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_vigneshwar0803_pipeline` is a English model originally trained by Vigneshwar0803. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_vigneshwar0803_pipeline_en_5.4.2_3.0_1724764802143.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_vigneshwar0803_pipeline_en_5.4.2_3.0_1724764802143.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_vigneshwar0803_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_vigneshwar0803_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_vigneshwar0803_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/Vigneshwar0803/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_en.md new file mode 100644 index 00000000000000..7c59bc6d64c873 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_yoon_1014 T5Transformer from yk2678 +author: John Snow Labs +name: t5_small_finetuned_yoon_1014 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_yoon_1014` is a English model originally trained by yk2678. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_yoon_1014_en_5.4.2_3.0_1724750597447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_yoon_1014_en_5.4.2_3.0_1724750597447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_yoon_1014","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_yoon_1014", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_yoon_1014| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.5 MB| + +## References + +https://huggingface.co/yk2678/t5-small-finetuned-yoon_1014 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_pipeline_en.md new file mode 100644 index 00000000000000..345ca6a2d8a185 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_finetuned_yoon_1014_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_yoon_1014_pipeline pipeline T5Transformer from yk2678 +author: John Snow Labs +name: t5_small_finetuned_yoon_1014_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_yoon_1014_pipeline` is a English model originally trained by yk2678. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_yoon_1014_pipeline_en_5.4.2_3.0_1724750620123.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_yoon_1014_pipeline_en_5.4.2_3.0_1724750620123.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_yoon_1014_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_yoon_1014_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_yoon_1014_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.5 MB| + +## References + +https://huggingface.co/yk2678/t5-small-finetuned-yoon_1014 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_en.md new file mode 100644 index 00000000000000..e9e84be8a903f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_hizclick T5Transformer from hizclick +author: John Snow Labs +name: t5_small_hizclick +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hizclick` is a English model originally trained by hizclick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hizclick_en_5.4.2_3.0_1724755776235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hizclick_en_5.4.2_3.0_1724755776235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_hizclick","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_hizclick", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hizclick| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hizclick/t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_pipeline_en.md new file mode 100644 index 00000000000000..013213c6aa7b89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hizclick_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_hizclick_pipeline pipeline T5Transformer from hizclick +author: John Snow Labs +name: t5_small_hizclick_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hizclick_pipeline` is a English model originally trained by hizclick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hizclick_pipeline_en_5.4.2_3.0_1724755827042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hizclick_pipeline_en_5.4.2_3.0_1724755827042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_hizclick_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_hizclick_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hizclick_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hizclick/t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_en.md new file mode 100644 index 00000000000000..79baf374502701 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_hotpot_qa_qg T5Transformer from ck46 +author: John Snow Labs +name: t5_small_hotpot_qa_qg +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hotpot_qa_qg` is a English model originally trained by ck46. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hotpot_qa_qg_en_5.4.2_3.0_1724759896552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hotpot_qa_qg_en_5.4.2_3.0_1724759896552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_hotpot_qa_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_hotpot_qa_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hotpot_qa_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.5 MB| + +## References + +https://huggingface.co/ck46/t5-small-hotpot-qa-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_pipeline_en.md new file mode 100644 index 00000000000000..8e5c683f265aa3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_hotpot_qa_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_hotpot_qa_qg_pipeline pipeline T5Transformer from ck46 +author: John Snow Labs +name: t5_small_hotpot_qa_qg_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hotpot_qa_qg_pipeline` is a English model originally trained by ck46. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hotpot_qa_qg_pipeline_en_5.4.2_3.0_1724759913446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hotpot_qa_qg_pipeline_en_5.4.2_3.0_1724759913446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_hotpot_qa_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_hotpot_qa_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hotpot_qa_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.5 MB| + +## References + +https://huggingface.co/ck46/t5-small-hotpot-qa-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_en.md new file mode 100644 index 00000000000000..ea4ac7b93db085 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_ctx_a T5Transformer from tiagoblima +author: John Snow Labs +name: t5_small_qg_ctx_a +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_ctx_a` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_ctx_a_en_5.4.2_3.0_1724769390787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_ctx_a_en_5.4.2_3.0_1724769390787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_ctx_a","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_ctx_a", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_ctx_a| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_small-qg-ctx-a \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_pipeline_en.md new file mode 100644 index 00000000000000..98e8b48ac93206 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_qg_ctx_a_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_ctx_a_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_small_qg_ctx_a_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_ctx_a_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_ctx_a_pipeline_en_5.4.2_3.0_1724769412912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_ctx_a_pipeline_en_5.4.2_3.0_1724769412912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_ctx_a_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_ctx_a_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_ctx_a_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_small-qg-ctx-a + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_en.md new file mode 100644 index 00000000000000..40e12871122c09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_trans_old T5Transformer from longcld +author: John Snow Labs +name: t5_small_squad_trans_old +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_trans_old` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_trans_old_en_5.4.2_3.0_1724744953431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_trans_old_en_5.4.2_3.0_1724744953431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_trans_old","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_trans_old", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_trans_old| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/longcld/t5_small_squad_trans_old \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_pipeline_en.md new file mode 100644 index 00000000000000..04b8c8e4e6ae4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_small_squad_trans_old_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_trans_old_pipeline pipeline T5Transformer from longcld +author: John Snow Labs +name: t5_small_squad_trans_old_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_trans_old_pipeline` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_trans_old_pipeline_en_5.4.2_3.0_1724745048231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_trans_old_pipeline_en_5.4.2_3.0_1724745048231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_trans_old_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_trans_old_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_trans_old_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/longcld/t5_small_squad_trans_old + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_en.md new file mode 100644 index 00000000000000..1b0f82f577331a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_text2sql_english_unidecode T5Transformer from TeeA +author: John Snow Labs +name: t5_text2sql_english_unidecode +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_text2sql_english_unidecode` is a English model originally trained by TeeA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_text2sql_english_unidecode_en_5.4.2_3.0_1724738682154.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_text2sql_english_unidecode_en_5.4.2_3.0_1724738682154.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_text2sql_english_unidecode","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_text2sql_english_unidecode", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_text2sql_english_unidecode| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/TeeA/t5-text2sql-english-unidecode \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_pipeline_en.md new file mode 100644 index 00000000000000..063b958ff670f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_text2sql_english_unidecode_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_text2sql_english_unidecode_pipeline pipeline T5Transformer from TeeA +author: John Snow Labs +name: t5_text2sql_english_unidecode_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_text2sql_english_unidecode_pipeline` is a English model originally trained by TeeA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_text2sql_english_unidecode_pipeline_en_5.4.2_3.0_1724738698776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_text2sql_english_unidecode_pipeline_en_5.4.2_3.0_1724738698776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_text2sql_english_unidecode_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_text2sql_english_unidecode_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_text2sql_english_unidecode_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/TeeA/t5-text2sql-english-unidecode + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_en.md new file mode 100644 index 00000000000000..de809b410ef36b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_base_gramatika_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: t5_v1_1_base_gramatika_e8_b16 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_gramatika_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_gramatika_e8_b16_en_5.4.2_3.0_1724768247179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_gramatika_e8_b16_en_5.4.2_3.0_1724768247179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_base_gramatika_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_base_gramatika_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_gramatika_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|954.8 MB| + +## References + +https://huggingface.co/jeremyvictor/t5-v1_1-base-gramatika-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..af9193974b42e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5_v1_1_base_gramatika_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_base_gramatika_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: t5_v1_1_base_gramatika_e8_b16_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_gramatika_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_gramatika_e8_b16_pipeline_en_5.4.2_3.0_1724768310371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_gramatika_e8_b16_pipeline_en_5.4.2_3.0_1724768310371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_base_gramatika_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_base_gramatika_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_gramatika_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|954.8 MB| + +## References + +https://huggingface.co/jeremyvictor/t5-v1_1-base-gramatika-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_en.md new file mode 100644 index 00000000000000..bcd5585e05f771 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_adv_base64_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_base64_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_base64_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_2_en_5.4.2_3.0_1724728553153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_2_en_5.4.2_3.0_1724728553153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_adv_base64_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_adv_base64_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_base64_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_base64_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_pipeline_en.md new file mode 100644 index 00000000000000..0d1527c885b6f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_adv_base64_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_adv_base64_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_base64_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_base64_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_2_pipeline_en_5.4.2_3.0_1724728697486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_base64_2_pipeline_en_5.4.2_3.0_1724728697486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_adv_base64_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_adv_base64_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_base64_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_base64_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_en.md new file mode 100644 index 00000000000000..b82c6e7fe409b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_style_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_style_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_style_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_2_en_5.4.2_3.0_1724744993607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_2_en_5.4.2_3.0_1724744993607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_style_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_style_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_style_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_style_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_pipeline_en.md new file mode 100644 index 00000000000000..449be0c5d77cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_sst2_style_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_style_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_style_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_style_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_2_pipeline_en_5.4.2_3.0_1724745123742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_2_pipeline_en_5.4.2_3.0_1724745123742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_style_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_style_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_style_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_style_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_en.md new file mode 100644 index 00000000000000..8d250855f03887 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_1 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_1_en_5.4.2_3.0_1724739646621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_1_en_5.4.2_3.0_1724739646621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_pipeline_en.md new file mode 100644 index 00000000000000..c8311a1e8370fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_1_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_1_pipeline_en_5.4.2_3.0_1724739794657.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_1_pipeline_en_5.4.2_3.0_1724739794657.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_addsent_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_addsent_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_en.md new file mode 100644 index 00000000000000..36500cb853d0c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_instruction_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_instruction_2_en_5.4.2_3.0_1724721809923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_instruction_2_en_5.4.2_3.0_1724721809923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..78d5b77a0a7912 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_addsent_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_instruction_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_instruction_2_pipeline_en_5.4.2_3.0_1724721945287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_instruction_2_pipeline_en_5.4.2_3.0_1724721945287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_addsent_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_addsent_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_en.md new file mode 100644 index 00000000000000..d7ff6dff4f36d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_own_adv_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_own_adv_instruction_0 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_own_adv_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_0_en_5.4.2_3.0_1724734789276.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_0_en_5.4.2_3.0_1724734789276.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_own_adv_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_own_adv_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..b260935d3339c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_trec_coarse_own_adv_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_own_adv_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_own_adv_instruction_0_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_own_adv_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_0_pipeline_en_5.4.2_3.0_1724734921653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_0_pipeline_en_5.4.2_3.0_1724734921653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_own_adv_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_own_adv_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_own_adv_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_own_adv_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_en.md new file mode 100644 index 00000000000000..636b3d04e9f973 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_bite_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_bite_2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_bite_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bite_2_en_5.4.2_3.0_1724741385119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bite_2_en_5.4.2_3.0_1724741385119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_bite_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_bite_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_bite_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_BITE_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_pipeline_en.md new file mode 100644 index 00000000000000..841d8ab9b24edc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5large_tweet_emotion_bite_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_bite_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_bite_2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_bite_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bite_2_pipeline_en_5.4.2_3.0_1724741522656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bite_2_pipeline_en_5.4.2_3.0_1724741522656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_bite_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_bite_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_bite_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_BITE_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_en.md new file mode 100644 index 00000000000000..4d64cd74d85c3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5v1_small_finetune_ag_news_main_model T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5v1_small_finetune_ag_news_main_model +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5v1_small_finetune_ag_news_main_model` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5v1_small_finetune_ag_news_main_model_en_5.4.2_3.0_1724730465278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5v1_small_finetune_ag_news_main_model_en_5.4.2_3.0_1724730465278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5v1_small_finetune_ag_news_main_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5v1_small_finetune_ag_news_main_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5v1_small_finetune_ag_news_main_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5v1_small_finetune_ag_news_main_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_pipeline_en.md new file mode 100644 index 00000000000000..f83dccb8f25721 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-t5v1_small_finetune_ag_news_main_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5v1_small_finetune_ag_news_main_model_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5v1_small_finetune_ag_news_main_model_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5v1_small_finetune_ag_news_main_model_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5v1_small_finetune_ag_news_main_model_pipeline_en_5.4.2_3.0_1724730484788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5v1_small_finetune_ag_news_main_model_pipeline_en_5.4.2_3.0_1724730484788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5v1_small_finetune_ag_news_main_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5v1_small_finetune_ag_news_main_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5v1_small_finetune_ag_news_main_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.3 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5v1_small_finetune_ag_news_main_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_en.md b/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_en.md new file mode 100644 index 00000000000000..b21ec1b7b47099 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tanl_based_materialsmine_ner T5Transformer from bingyinh +author: John Snow Labs +name: tanl_based_materialsmine_ner +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tanl_based_materialsmine_ner` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_en_5.4.2_3.0_1724717994793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_en_5.4.2_3.0_1724717994793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tanl_based_materialsmine_ner","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tanl_based_materialsmine_ner", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tanl_based_materialsmine_ner| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/TANL-based_MaterialsMine_NER \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_pipeline_en.md new file mode 100644 index 00000000000000..f690c0bbe71762 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-tanl_based_materialsmine_ner_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tanl_based_materialsmine_ner_pipeline pipeline T5Transformer from bingyinh +author: John Snow Labs +name: tanl_based_materialsmine_ner_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tanl_based_materialsmine_ner_pipeline` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_pipeline_en_5.4.2_3.0_1724718046999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_pipeline_en_5.4.2_3.0_1724718046999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tanl_based_materialsmine_ner_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tanl_based_materialsmine_ner_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tanl_based_materialsmine_ner_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/TANL-based_MaterialsMine_NER + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-tawant5_en.md b/docs/_posts/ahmedlone127/2024-08-27-tawant5_en.md new file mode 100644 index 00000000000000..5152a1c5e866f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-tawant5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tawant5 T5Transformer from Tawanmeansthesun +author: John Snow Labs +name: tawant5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tawant5` is a English model originally trained by Tawanmeansthesun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tawant5_en_5.4.2_3.0_1724737104528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tawant5_en_5.4.2_3.0_1724737104528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tawant5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tawant5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tawant5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.9 GB| + +## References + +https://huggingface.co/Tawanmeansthesun/tawant5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-test2_en.md b/docs/_posts/ahmedlone127/2024-08-27-test2_en.md new file mode 100644 index 00000000000000..d1157be29a422c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-test2_en.md @@ -0,0 +1,92 @@ +--- +layout: model +title: English test2 DistilBertForTokenClassification from yam1ke +author: John Snow Labs +name: test2 +date: 2024-08-27 +tags: [bert, en, open_source, token_classification, onnx] +task: Named Entity Recognition +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained DistilBertForTokenClassification model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test2` is a English model originally trained by yam1ke. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test2_en_5.4.2_3.0_1724727000830.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test2_en_5.4.2_3.0_1724727000830.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCol("text") \ + .setOutputCol("documents") + + +tokenClassifier = DistilBertForTokenClassification.pretrained("test2","en") \ + .setInputCols(["documents","token"]) \ + .setOutputCol("ner") + +pipeline = Pipeline().setStages([documentAssembler, tokenClassifier]) + +pipelineModel = pipeline.fit(data) + +pipelineDF = pipelineModel.transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCol("text") + .setOutputCol("embeddings") + +val tokenClassifier = DistilBertForTokenClassification + .pretrained("test2", "en") + .setInputCols(Array("documents","token")) + .setOutputCol("ner") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, tokenClassifier)) + +val pipelineModel = pipeline.fit(data) + +val pipelineDF = pipelineModel.transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +References + +https://huggingface.co/yam1ke/test2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-test2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-test2_pipeline_en.md new file mode 100644 index 00000000000000..8cc1629c97513c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-test2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test2_pipeline pipeline T5Transformer from piazzola +author: John Snow Labs +name: test2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test2_pipeline` is a English model originally trained by piazzola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test2_pipeline_en_5.4.2_3.0_1724727057056.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test2_pipeline_en_5.4.2_3.0_1724727057056.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/piazzola/test2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_en.md b/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_en.md new file mode 100644 index 00000000000000..2f894d83aea312 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_prod_exigent_t5 T5Transformer from RishuD7 +author: John Snow Labs +name: test_prod_exigent_t5 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_prod_exigent_t5` is a English model originally trained by RishuD7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_prod_exigent_t5_en_5.4.2_3.0_1724770083225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_prod_exigent_t5_en_5.4.2_3.0_1724770083225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_prod_exigent_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_prod_exigent_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_prod_exigent_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RishuD7/test_prod_exigent_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_pipeline_en.md new file mode 100644 index 00000000000000..e6e6523e63c00a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-test_prod_exigent_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_prod_exigent_t5_pipeline pipeline T5Transformer from RishuD7 +author: John Snow Labs +name: test_prod_exigent_t5_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_prod_exigent_t5_pipeline` is a English model originally trained by RishuD7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_prod_exigent_t5_pipeline_en_5.4.2_3.0_1724770134592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_prod_exigent_t5_pipeline_en_5.4.2_3.0_1724770134592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_prod_exigent_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_prod_exigent_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_prod_exigent_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RishuD7/test_prod_exigent_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_en.md new file mode 100644 index 00000000000000..ff40e2587b3a61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_exps_t5_10_aug T5Transformer from james-burton +author: John Snow Labs +name: text_exps_t5_10_aug +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_t5_10_aug` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_t5_10_aug_en_5.4.2_3.0_1724764054156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_t5_10_aug_en_5.4.2_3.0_1724764054156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_exps_t5_10_aug","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_exps_t5_10_aug", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_t5_10_aug| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|968.0 MB| + +## References + +https://huggingface.co/james-burton/text-exps-t5-10-aug \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_pipeline_en.md new file mode 100644 index 00000000000000..e435bb046dc27d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_exps_t5_10_aug_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_exps_t5_10_aug_pipeline pipeline T5Transformer from james-burton +author: John Snow Labs +name: text_exps_t5_10_aug_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_t5_10_aug_pipeline` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_t5_10_aug_pipeline_en_5.4.2_3.0_1724764113871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_t5_10_aug_pipeline_en_5.4.2_3.0_1724764113871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_exps_t5_10_aug_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_exps_t5_10_aug_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_t5_10_aug_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|968.0 MB| + +## References + +https://huggingface.co/james-burton/text-exps-t5-10-aug + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_en.md new file mode 100644 index 00000000000000..58c11d47f5b44a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v2 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v2` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v2_en_5.4.2_3.0_1724747967720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v2_en_5.4.2_3.0_1724747967720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_pipeline_en.md new file mode 100644 index 00000000000000..1d7a0f0a695d00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v2_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v2_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v2_pipeline_en_5.4.2_3.0_1724747986384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v2_pipeline_en_5.4.2_3.0_1724747986384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_en.md new file mode 100644 index 00000000000000..b4f60dde281f43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v59 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v59 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v59` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v59_en_5.4.2_3.0_1724756399585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v59_en_5.4.2_3.0_1724756399585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v59","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v59", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v59| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v59 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_pipeline_en.md new file mode 100644 index 00000000000000..dde7295f14a426 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v59_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v59_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v59_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v59_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v59_pipeline_en_5.4.2_3.0_1724756420409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v59_pipeline_en_5.4.2_3.0_1724756420409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v59_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v59_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v59_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v59 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_en.md new file mode 100644 index 00000000000000..238181786d69df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v70 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v70 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v70` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v70_en_5.4.2_3.0_1724759799744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v70_en_5.4.2_3.0_1724759799744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v70","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v70", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v70| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v70 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_pipeline_en.md new file mode 100644 index 00000000000000..897e9d66691a8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-text_shortening_model_v70_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v70_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v70_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v70_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v70_pipeline_en_5.4.2_3.0_1724759818255.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v70_pipeline_en_5.4.2_3.0_1724759818255.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v70_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v70_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v70_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v70 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_en.md new file mode 100644 index 00000000000000..284c5bc278c1b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English transcriber_t5_v8_nepal_bhasa T5Transformer from odunola +author: John Snow Labs +name: transcriber_t5_v8_nepal_bhasa +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`transcriber_t5_v8_nepal_bhasa` is a English model originally trained by odunola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/transcriber_t5_v8_nepal_bhasa_en_5.4.2_3.0_1724724482695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/transcriber_t5_v8_nepal_bhasa_en_5.4.2_3.0_1724724482695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("transcriber_t5_v8_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("transcriber_t5_v8_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|transcriber_t5_v8_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/odunola/transcriber-t5-v8-new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..6037efc6634ca8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-transcriber_t5_v8_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English transcriber_t5_v8_nepal_bhasa_pipeline pipeline T5Transformer from odunola +author: John Snow Labs +name: transcriber_t5_v8_nepal_bhasa_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`transcriber_t5_v8_nepal_bhasa_pipeline` is a English model originally trained by odunola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/transcriber_t5_v8_nepal_bhasa_pipeline_en_5.4.2_3.0_1724724500557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/transcriber_t5_v8_nepal_bhasa_pipeline_en_5.4.2_3.0_1724724500557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("transcriber_t5_v8_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("transcriber_t5_v8_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|transcriber_t5_v8_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/odunola/transcriber-t5-v8-new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-translation_test2_en.md b/docs/_posts/ahmedlone127/2024-08-27-translation_test2_en.md new file mode 100644 index 00000000000000..50abc7c8ac6c06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-translation_test2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translation_test2 T5Transformer from nizarh1999 +author: John Snow Labs +name: translation_test2 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_test2` is a English model originally trained by nizarh1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_test2_en_5.4.2_3.0_1724766152653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_test2_en_5.4.2_3.0_1724766152653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_test2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_test2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_test2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.0 MB| + +## References + +https://huggingface.co/nizarh1999/translation_test2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-translation_test2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-translation_test2_pipeline_en.md new file mode 100644 index 00000000000000..21575427d12770 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-translation_test2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translation_test2_pipeline pipeline T5Transformer from nizarh1999 +author: John Snow Labs +name: translation_test2_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_test2_pipeline` is a English model originally trained by nizarh1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_test2_pipeline_en_5.4.2_3.0_1724766175205.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_test2_pipeline_en_5.4.2_3.0_1724766175205.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_test2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_test2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_test2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.0 MB| + +## References + +https://huggingface.co/nizarh1999/translation_test2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_en.md b/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_en.md new file mode 100644 index 00000000000000..8d88e5f24a8973 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tst_summarization_trangdo T5Transformer from TrangDo +author: John Snow Labs +name: tst_summarization_trangdo +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tst_summarization_trangdo` is a English model originally trained by TrangDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tst_summarization_trangdo_en_5.4.2_3.0_1724721943488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tst_summarization_trangdo_en_5.4.2_3.0_1724721943488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tst_summarization_trangdo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tst_summarization_trangdo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tst_summarization_trangdo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|961.2 MB| + +## References + +https://huggingface.co/TrangDo/tst-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_pipeline_en.md new file mode 100644 index 00000000000000..76e61f20161de2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-tst_summarization_trangdo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tst_summarization_trangdo_pipeline pipeline T5Transformer from TrangDo +author: John Snow Labs +name: tst_summarization_trangdo_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tst_summarization_trangdo_pipeline` is a English model originally trained by TrangDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tst_summarization_trangdo_pipeline_en_5.4.2_3.0_1724722007283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tst_summarization_trangdo_pipeline_en_5.4.2_3.0_1724722007283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tst_summarization_trangdo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tst_summarization_trangdo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tst_summarization_trangdo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|961.2 MB| + +## References + +https://huggingface.co/TrangDo/tst-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_en.md b/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_en.md new file mode 100644 index 00000000000000..6d9ef876ec9efe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English updated_t5_squad_long_vam T5Transformer from vishal2014 +author: John Snow Labs +name: updated_t5_squad_long_vam +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`updated_t5_squad_long_vam` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/updated_t5_squad_long_vam_en_5.4.2_3.0_1724755218299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/updated_t5_squad_long_vam_en_5.4.2_3.0_1724755218299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("updated_t5_squad_long_vam","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("updated_t5_squad_long_vam", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|updated_t5_squad_long_vam| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/updated_t5_squad_long_vam \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_pipeline_en.md new file mode 100644 index 00000000000000..75e083bec44cd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-updated_t5_squad_long_vam_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English updated_t5_squad_long_vam_pipeline pipeline T5Transformer from vishal2014 +author: John Snow Labs +name: updated_t5_squad_long_vam_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`updated_t5_squad_long_vam_pipeline` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/updated_t5_squad_long_vam_pipeline_en_5.4.2_3.0_1724755268216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/updated_t5_squad_long_vam_pipeline_en_5.4.2_3.0_1724755268216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("updated_t5_squad_long_vam_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("updated_t5_squad_long_vam_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|updated_t5_squad_long_vam_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/updated_t5_squad_long_vam + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_en.md b/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_en.md new file mode 100644 index 00000000000000..b5e0ddd3c17951 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_2048_gen512 T5Transformer from anhdt-dsai-02 +author: John Snow Labs +name: vit5_2048_gen512 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_2048_gen512` is a English model originally trained by anhdt-dsai-02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_2048_gen512_en_5.4.2_3.0_1724769282764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_2048_gen512_en_5.4.2_3.0_1724769282764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_2048_gen512","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_2048_gen512", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_2048_gen512| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhdt-dsai-02/ViT5_2048_gen512 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_pipeline_en.md new file mode 100644 index 00000000000000..5278abf3ee1e74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vit5_2048_gen512_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_2048_gen512_pipeline pipeline T5Transformer from anhdt-dsai-02 +author: John Snow Labs +name: vit5_2048_gen512_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_2048_gen512_pipeline` is a English model originally trained by anhdt-dsai-02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_2048_gen512_pipeline_en_5.4.2_3.0_1724769340742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_2048_gen512_pipeline_en_5.4.2_3.0_1724769340742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_2048_gen512_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_2048_gen512_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_2048_gen512_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhdt-dsai-02/ViT5_2048_gen512 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_en.md b/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_en.md new file mode 100644 index 00000000000000..743dd78ee43418 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903 T5Transformer from lehonganh1903 +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903 +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903` is a English model originally trained by lehonganh1903. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_en_5.4.2_3.0_1724717364130.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_en_5.4.2_3.0_1724717364130.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lehonganh1903/vit5-base-vietnews-summarization-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline_en.md new file mode 100644 index 00000000000000..1ed5372f128b14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline pipeline T5Transformer from lehonganh1903 +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline` is a English model originally trained by lehonganh1903. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline_en_5.4.2_3.0_1724717415694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline_en_5.4.2_3.0_1724717415694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_lehonganh1903_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lehonganh1903/vit5-base-vietnews-summarization-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vivabot_en.md b/docs/_posts/ahmedlone127/2024-08-27-vivabot_en.md new file mode 100644 index 00000000000000..87891b471e0c68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vivabot_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vivabot T5Transformer from SharanRP +author: John Snow Labs +name: vivabot +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vivabot` is a English model originally trained by SharanRP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vivabot_en_5.4.2_3.0_1724721077910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vivabot_en_5.4.2_3.0_1724721077910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vivabot","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vivabot", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vivabot| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SharanRP/VivaBot \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-vivabot_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-vivabot_pipeline_en.md new file mode 100644 index 00000000000000..4c0b4c8af5b07e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-vivabot_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vivabot_pipeline pipeline T5Transformer from SharanRP +author: John Snow Labs +name: vivabot_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vivabot_pipeline` is a English model originally trained by SharanRP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vivabot_pipeline_en_5.4.2_3.0_1724721130393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vivabot_pipeline_en_5.4.2_3.0_1724721130393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vivabot_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vivabot_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vivabot_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SharanRP/VivaBot + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_en.md new file mode 100644 index 00000000000000..bbe391520d1cce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wikipedia_summaries_t5_small T5Transformer from tarekziade +author: John Snow Labs +name: wikipedia_summaries_t5_small +date: 2024-08-27 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wikipedia_summaries_t5_small` is a English model originally trained by tarekziade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wikipedia_summaries_t5_small_en_5.4.2_3.0_1724752298157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wikipedia_summaries_t5_small_en_5.4.2_3.0_1724752298157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wikipedia_summaries_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wikipedia_summaries_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wikipedia_summaries_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/tarekziade/wikipedia-summaries-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..815333649e4a04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-27-wikipedia_summaries_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wikipedia_summaries_t5_small_pipeline pipeline T5Transformer from tarekziade +author: John Snow Labs +name: wikipedia_summaries_t5_small_pipeline +date: 2024-08-27 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wikipedia_summaries_t5_small_pipeline` is a English model originally trained by tarekziade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wikipedia_summaries_t5_small_pipeline_en_5.4.2_3.0_1724752315309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wikipedia_summaries_t5_small_pipeline_en_5.4.2_3.0_1724752315309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wikipedia_summaries_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wikipedia_summaries_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wikipedia_summaries_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/tarekziade/wikipedia-summaries-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file